00010000:00010000:0.0F:1789583979.547475:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0F:1789583980.081125:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:2.0:1789583980.081170:0:6470:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f8dc7d14900 refcount 2 committed 0 result 0 batchid 4294967531 00000020:00080000:2.0:1789583980.081176:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f8dc817ca00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f8dc7d14b40 00000020:00080000:2.0:1789583980.081180:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f8dc817c600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f8cc4acc800 00010000:00010000:0.0:1789583980.081266:0:3440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61600/0x113b6add9f869171 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583980.081279:0:3440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61600/0x113b6add9f869171 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583980.081287:0:3440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61600/0x113b6add9f869171 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583980.081293:0:3440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c61600 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:0.0:1789583980.081298:0:3440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61600/0x113b6add9f869171 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583980.081305:0:3440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61600/0x113b6add9f869171 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583980.081323:0:3440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f8de85b4c00) 00010000:00010000:0.0:1789583980.081326:0:3440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583980.081332:0:3440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61600/0x113b6add9f869171 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583980.081337:0:3440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61600/0x113b6add9f869171 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16433 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0F:1789583980.081408:0:16474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967531 committed batchid 8 00000020:00080000:1.0:1789583980.081619:0:16474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1789583980.191381:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789583980.191560:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228550144 00000100:00100000:2.0:1789583980.191570:0:16426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228550144 00000100:00100000:2.0:1789583980.191620:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 168 00000100:00100000:2.0:1789583980.191629:0:16426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df5171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b27b7af-4f39-4d86-bddb-f5b775fff529+13:2402:x1876514228550144:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1789583980.191691:0:16426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df5171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b27b7af-4f39-4d86-bddb-f5b775fff529+13:2402:x1876514228550144:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 63us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583980.191698:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 168 00000100:00100000:3.0F:1789583980.192620:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789583980.192735:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789583980.192813:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789583980.192839:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228550400 00000100:00100000:3.0:1789583980.192844:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228550400 00000100:00100000:3.0:1789583980.192880:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228550272 00000100:00100000:3.0:1789583980.192882:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228550272 00000100:00100000:3.0:1789583980.192900:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 75 00000100:00100000:3.0:1789583980.192907:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+5:2402:x1876514228550400:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789583980.192966:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+5:2402:x1876514228550400:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 60us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583980.192973:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 75 00000100:00100000:3.0:1789583980.193104:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 76 00000100:00100000:3.0:1789583980.193111:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+11:2402:x1876514228550272:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789583980.193152:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+11:2402:x1876514228550272:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 41us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583980.193158:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 76 00000100:00100000:3.0:1789583980.193175:0:17744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228550528 00000100:00100000:3.0:1789583980.193178:0:17744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228550528 00000100:00080000:2.0:1789583980.194256:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789583980.194264:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789583980.194515:0:17744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 36 00000100:00100000:3.0:1789583980.194526:0:17744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+8:2402:x1876514228550528:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789583980.194579:0:17744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+8:2402:x1876514228550528:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 56us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583980.194586:0:17744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 36 00000100:00080000:3.0:1789583980.194686:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789583980.219400:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789583980.219436:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789583980.219456:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789583980.219485:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789583980.219520:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789583980.219546:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228550912 00000100:00100000:0.0:1789583980.219555:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228550912 00000100:00100000:0.0:1789583980.219616:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228550784 00000100:00100000:0.0:1789583980.219632:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228550784 00000100:00100000:0.0:1789583980.219662:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 77 00000100:00100000:0.0:1789583980.219672:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+5:2401:x1876514228550912:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1789583980.219740:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+5:2401:x1876514228550912:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 70us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583980.219747:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 77 00000100:00100000:0.0:1789583980.219763:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 78 00000100:00100000:0.0:1789583980.219770:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+6:2401:x1876514228550784:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1789583980.219792:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+6:2401:x1876514228550784:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 23us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583980.219797:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 78 00000100:00100000:0.0:1789583980.219816:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228550656 00000100:00100000:0.0:1789583980.219819:0:17746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228550656 00000100:00100000:0.0:1789583980.219839:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228551040 00000100:00100000:0.0:1789583980.219842:0:17746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228551040 00000100:00100000:0.0:1789583980.219855:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228551168 00000100:00100000:0.0:1789583980.219858:0:17746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228551168 00000100:00100000:0.0:1789583980.219873:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 31 00000100:00100000:0.0:1789583980.219879:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+5:2398:x1876514228550656:12345-192.168.204.11@tcp:9:kworker.0 00000020:00000080:0.0:1789583980.219899:0:17746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868e3e 00000100:00080000:0.0:1789583980.219912:0:17746:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4af2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789583980.219946:0:17746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789583980.220156:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+2:2398:x1876514228550656:12345-192.168.204.11@tcp:9:kworker.0 Request processed in 276us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583980.220162:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 31 00000100:00100000:0.0:1789583980.220174:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 32 00000100:00100000:0.0:1789583980.220180:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+5:2398:x1876514228551040:12345-192.168.204.11@tcp:9:kworker.0 00000020:00000080:0.0:1789583980.220227:0:17746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868e76 00000100:00080000:0.0:1789583980.220234:0:17746:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4af0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789583980.220252:0:17746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1789583980.220370:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+2:2398:x1876514228551040:12345-192.168.204.11@tcp:9:kworker.0 Request processed in 190us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583980.220377:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 32 00000100:00100000:0.0:1789583980.220388:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00100000:0.0:1789583980.220395:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+5:2398:x1876514228551168:12345-192.168.204.11@tcp:9:kworker.0 00000020:00000080:0.0:1789583980.220405:0:17746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868e7d 00000100:00080000:0.0:1789583980.220410:0:17746:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4af2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789583980.220421:0:17746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789583980.220489:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+2:2398:x1876514228551168:12345-192.168.204.11@tcp:9:kworker.0 Request processed in 95us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583980.220495:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00080000:0.0:1789583980.220515:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789583980.220519:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789583980.220522:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789583980.220524:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789583980.220619:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583980.220802:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583980.571534:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583981.540307:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789583981.540331:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253805440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789583981.540399:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583981.541444:0:17749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253805440 00000100:00100000:2.0:1789583981.541456:0:17749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253805440 00000100:00100000:2.0:1789583981.541528:0:17749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789583981.541537:0:17749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc5c02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253805440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789583981.541572:0:17749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583981.541634:0:17749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc5c02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253805440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583981.541641:0:17749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789583981.541654:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253805440:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789583981.542523:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789583981.602763:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789583981.615589:0:8131:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 74c62c8b-20fd-4180-b5fa-7ba19c1807c1 00000020:00000080:3.0:1789583981.615611:0:8131:0:(genops.c:885:class_export_put()) final put ffff8f8cc4af6000/74c62c8b-20fd-4180-b5fa-7ba19c1807c1 00000001:00080000:3.0:1789583981.615650:0:8131:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000020:00000080:3.0:1789583981.615668:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc4af6000/74c62c8b-20fd-4180-b5fa-7ba19c1807c1 for lustre-OST0000 00000020:00000080:3.0:1789583981.615718:0:12001:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8cc4af0800 for lustre-OST0000 00000100:00100000:1.0:1789583981.939279:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789583981.939424:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228551296 00000100:00100000:3.0:1789583981.939434:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228551296 00000100:00100000:3.0:1789583981.939494:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 72 00000100:00100000:3.0:1789583981.939505:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc5c02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+11:15715:x1876514228551296:12345-192.168.204.11@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789583981.939790:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc5c02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+11:15715:x1876514228551296:12345-192.168.204.11@tcp:60:lhsmtool_posix.0 Request processed in 285us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583981.939798:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 72 00000100:00100000:0.0:1789583981.951401:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789583981.951497:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228551424 00000100:00100000:3.0:1789583981.951508:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228551424 00000100:00100000:3.0:1789583981.951580:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 73 00000100:00100000:3.0:1789583981.951591:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+5:15715:x1876514228551424:12345-192.168.204.11@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789583981.951700:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+5:15715:x1876514228551424:12345-192.168.204.11@tcp:60:lhsmtool_posix.0 Request processed in 110us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583981.951707:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 73 00000100:00100000:1.0:1789583981.972519:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789583981.972713:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228551680 00000100:00100000:0.0:1789583981.972733:0:16435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228551680 00000100:00100000:0.0:1789583981.972828:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:0.0:1789583981.972840:0:16435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8de0823050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+11:15715:x1876514228551680:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789583981.973127:0:16435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8de0823050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+12:15715:x1876514228551680:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 290us (623us total) trans 8589934636 rc 0/0 00000100:00100000:0.0:1789583981.973151:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:2.0:1789583982.043652:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc5c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253805568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789583982.043782:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583982.043940:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253805696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789583982.043998:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583982.044045:0:17344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253805568 00000100:00100000:1.0:1789583982.044052:0:17344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253805568 00000100:00100000:1.0:1789583982.044087:0:17344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253805696 00000100:00100000:1.0:1789583982.044090:0:17344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253805696 00000100:00100000:1.0:1789583982.044105:0:17344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789583982.044112:0:17344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253805568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789583982.044151:0:17344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789583982.044259:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789583982.044269:0:16437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc5c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253805696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789583982.044290:0:16437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789583982.044326:0:16437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc5c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253805696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583982.044333:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789583982.044393:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253805696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789583982.055978:0:17344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253805568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 11852us (12182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583982.055994:0:17344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789583982.063096:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc5c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253805568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789583982.555774:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc5c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253805824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789583982.555850:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583982.555998:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc5c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253806336:0@lo:400:kworker.0 00000100:00100000:1.0:1789583982.556025:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583982.556043:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253806848:0@lo:400:kworker.0 00000100:00100000:1.0:1789583982.556066:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583982.556081:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789583982.556103:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc5c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3456:1876514253805952:0@lo:400:kworker.0 00000100:00100000:1.0:1789583982.556132:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583982.556170:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc5c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253806464:0@lo:400:kworker.0 00000100:00100000:1.0:1789583982.556217:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583982.556236:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3456:1876514253806976:0@lo:400:kworker.0 00000100:00100000:1.0:1789583982.556257:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583982.556285:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253806336 00000100:00100000:1.0:1789583982.556293:0:17746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253806336 00000100:00100000:2.0:1789583982.556458:0:17749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253805824 00000100:00100000:2.0:1789583982.556462:0:17749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253805824 00000100:00100000:2.0:1789583982.556508:0:17749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789583982.556527:0:17749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc5c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253805824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789583982.556562:0:17749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583982.556695:0:17749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc5c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253805824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583982.556703:0:17749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789583982.556728:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc5c01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253806080:0@lo:400:kworker.0 00000100:00100000:2.0:1789583982.556754:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583982.556774:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc5c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876514253806592:0@lo:400:kworker.0 00000100:00100000:2.0:1789583982.556794:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583982.556810:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3454:1876514253807104:0@lo:400:kworker.0 00000100:00100000:2.0:1789583982.556830:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583982.556848:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789583982.556853:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc5c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3454:1876514253806208:0@lo:400:kworker.0 00000100:00100000:2.0:1789583982.556873:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583982.556890:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3454:1876514253806720:0@lo:400:kworker.0 00000100:00100000:2.0:1789583982.556909:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583982.556920:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253807232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789583982.556939:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583982.556963:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253806848 00000100:00100000:2.0:1789583982.556967:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253806848 00000100:00100000:2.0:1789583982.556990:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253806976 00000100:00100000:2.0:1789583982.556993:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253806976 00000100:00100000:2.0:1789583982.557017:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253806592 00000100:00100000:2.0:1789583982.557019:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253806592 00000100:00100000:2.0:1789583982.557031:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253807104 00000100:00100000:2.0:1789583982.557033:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253807104 00000100:00100000:2.0:1789583982.557044:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253806208 00000100:00100000:2.0:1789583982.557046:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253806208 00000100:00100000:2.0:1789583982.557054:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253806720 00000100:00100000:2.0:1789583982.557057:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253806720 00000100:00100000:2.0:1789583982.557070:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789583982.557076:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876514253806848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583982.557110:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876514253806848:12345-0@lo:400:kworker.0 Request processed in 34us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583982.557116:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789583982.557128:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789583982.557135:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3456:x1876514253806976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583982.557173:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3456:x1876514253806976:12345-0@lo:400:kworker.0 Request processed in 40us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583982.557179:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789583982.557209:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789583982.557217:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876514253806592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583982.557248:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876514253806592:12345-0@lo:400:kworker.0 Request processed in 34us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583982.557254:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789583982.557265:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789583982.557273:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3454:x1876514253807104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583982.557299:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3454:x1876514253807104:12345-0@lo:400:kworker.0 Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583982.557315:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789583982.557340:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789583982.558963:0:18217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253806464 00000100:00100000:3.0:1789583982.558976:0:18217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253806464 00000100:00100000:3.0:1789583982.559038:0:18217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253806080 00000100:00100000:3.0:1789583982.559042:0:18217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253806080 00000100:00100000:3.0:1789583982.559065:0:18217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789583982.559074:0:18217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253806464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583982.559155:0:18217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253806464:12345-0@lo:400:kworker.0 Request processed in 82us (2936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583982.559161:0:18217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789583982.559214:0:18217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789583982.559221:0:18217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253806080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583982.559251:0:18217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253806080:12345-0@lo:400:kworker.0 Request processed in 31us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583982.559257:0:18217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789583982.559273:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253807232 00000100:00100000:3.0:1789583982.559277:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253807232 00000100:00100000:3.0:1789583982.559293:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789583982.559299:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253807232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789583982.559314:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583982.559347:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253807232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (2407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583982.559353:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789583982.559375:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789583982.559379:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789583982.559382:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789583982.559384:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789583982.559393:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253805952 00000100:00100000:3.0:1789583982.559397:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253805952 00000100:00100000:3.0:1789583982.559422:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789583982.559430:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df5172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfd2e540-776d-4d6d-9d40-7d81c66add0c+24:3456:x1876514253805952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583982.559463:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df5172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfd2e540-776d-4d6d-9d40-7d81c66add0c+24:3456:x1876514253805952:12345-0@lo:400:kworker.0 Request processed in 34us (3329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583982.559468:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789583982.559515:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789583982.559523:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3454:x1876514253806720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583982.559552:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3454:x1876514253806720:12345-0@lo:400:kworker.0 Request processed in 31us (2642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583982.559565:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789583982.562239:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789583982.562263:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253806336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583982.562349:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253806336:12345-0@lo:400:kworker.0 Request processed in 100us (6322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583982.562356:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789583982.562422:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc5c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3456:1876514253805952:0@lo:400:kworker.0 00000100:00100000:1.0:1789583982.562437:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc5c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253806464:0@lo:400:kworker.0 00000100:00100000:1.0:1789583982.562449:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3456:1876514253806976:0@lo:400:kworker.0 00000100:00100000:1.0:1789583982.562460:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc5c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253806336:0@lo:400:kworker.0 00010000:00080000:1.0:1789583982.562473:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dfd082a00 x1876514253806848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583982.562483:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253806848:0@lo:400:kworker.0 00000100:00100000:1.0:1789583982.562504:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc5c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253805824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789583982.562902:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3454:x1876514253806208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583982.562954:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3454:x1876514253806208:12345-0@lo:400:kworker.0 Request processed in 5608us (6078us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583982.562962:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789583982.563064:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc5c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3454:1876514253806208:0@lo:400:kworker.0 00000100:00100000:3.0:1789583982.563077:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3454:1876514253806720:0@lo:400:kworker.0 00000100:00100000:3.0:1789583982.563092:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253807232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789583982.563105:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc5c01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253806080:0@lo:400:kworker.0 00000100:00100000:3.0:1789583982.563116:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc5c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876514253806592:0@lo:400:kworker.0 00010000:00080000:3.0:1789583982.563128:0:3454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dfd083480 x1876514253807104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583982.563138:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3454:1876514253807104:0@lo:400:kworker.0 00000100:00100000:0.0:1789583982.566133:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789583982.566169:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253807360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789583982.566270:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583982.566648:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253807360 00000100:00100000:1.0:1789583982.566658:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253807360 00000100:00100000:1.0:1789583982.566729:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789583982.566739:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253807360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789583982.566761:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789583982.566812:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253807360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583982.566819:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789583982.566956:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253807360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789583982.621211:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789583983.158228:0:9074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 74c62c8b-20fd-4180-b5fa-7ba19c1807c1 00000020:00000080:3.0:1789583983.158242:0:9074:0:(genops.c:885:class_export_put()) final put ffff8f8cc4af5800/74c62c8b-20fd-4180-b5fa-7ba19c1807c1 00000001:00100000:3.0:1789583983.158271:0:9074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311 00000020:00000080:3.0:1789583983.158274:0:9074:0:(genops.c:885:class_export_put()) final put ffff8f8cc4af7800/274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311 00000020:00000080:2.0:1789583983.158615:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc4af5800/74c62c8b-20fd-4180-b5fa-7ba19c1807c1 for lustre-OST0001 00000020:00000080:2.0:1789583983.158695:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc4af7800/274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311 for lustre-OST0001 00000020:00000080:2.0:1789583983.158724:0:12001:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8cc4af2000 for lustre-OST0001 00000020:00000080:2.0:1789583983.158733:0:12001:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8cc4af2800 for lustre-OST0001 00010000:00010000:3.0:1789583983.645140:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789583984.347385:0:16468:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789583984.347399:0:16468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789583984.347438:0:16468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789583984.347445:0:16468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789583984.670332:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789583985.182962:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:3.0:1789583985.182981:0:6470:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967531 batchid updated 00000020:00080000:1.0:1789583985.183926:0:16474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967531 00000020:00080000:1.0:1789583985.183941:0:16474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967531 00000100:00100000:1.0:1789583985.313677:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583985.314724:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583985.314753:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789583985.317020:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228551936 00000100:00100000:0.0:1789583985.317037:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228551936 00000100:00100000:1.0:1789583985.317309:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583985.317341:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583985.317486:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789583985.317558:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228552448 00000100:00100000:3.0:1789583985.317563:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228552448 00000100:00100000:3.0:1789583985.317596:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228552064 00000100:00100000:3.0:1789583985.317600:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228552064 00000100:00100000:3.0:1789583985.317635:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 85 00000100:00100000:3.0:1789583985.317645:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+11:2400:x1876514228551936:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789583985.317852:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+11:2400:x1876514228551936:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 208us (4183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583985.317860:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 85 00000100:00100000:3.0:1789583985.317877:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 86 00000100:00100000:3.0:1789583985.317884:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+5:2400:x1876514228552448:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789583985.317978:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+5:2400:x1876514228552448:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 93us (3223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583985.317983:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 86 00000100:00100000:3.0:1789583985.317994:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 87 00000100:00100000:3.0:1789583985.317999:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+5:2400:x1876514228552064:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789583985.318021:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+5:2400:x1876514228552064:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 22us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583985.318026:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 87 00000100:00080000:3.0:1789583985.318044:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789583985.318048:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583985.318325:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228552192 00000100:00100000:1.0:1789583985.318330:0:17747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228552192 00000100:00100000:1.0:1789583985.318375:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:1.0:1789583985.318383:0:17747:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+6:2400:x1876514228552192:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1789583985.318417:0:17747:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+6:2400:x1876514228552192:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 35us (3697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583985.318423:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:1.0:1789583985.318444:0:16425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228551808 00000100:00100000:1.0:1789583985.318448:0:16425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228551808 00000100:00100000:1.0:1789583985.318471:0:16425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 170 00000100:00100000:1.0:1789583985.318477:0:16425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df5172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b27b7af-4f39-4d86-bddb-f5b775fff529+13:2400:x1876514228551808:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1789583985.318501:0:16425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df5172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b27b7af-4f39-4d86-bddb-f5b775fff529+13:2400:x1876514228551808:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 24us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583985.318516:0:16425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 170 00000100:00080000:0.0:1789583985.318592:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789583985.320442:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228552320 00000100:00100000:3.0:1789583985.320454:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228552320 00000100:00100000:3.0:1789583985.320564:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 88 00000100:00100000:3.0:1789583985.320573:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+6:2400:x1876514228552320:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789583985.320635:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+6:2400:x1876514228552320:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 63us (3149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583985.320642:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 88 00000100:00080000:3.0:1789583985.320690:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789583985.704936:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583986.665382:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd0a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253807488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789583986.665453:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583986.665619:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253807488 00000100:00100000:2.0:1789583986.665627:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253807488 00000100:00100000:2.0:1789583986.665679:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789583986.665688:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd0a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253807488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789583986.665721:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583986.665766:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd0a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253807488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583986.665774:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789583986.665795:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789583986.665943:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd0a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253807488:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789583986.719764:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789583987.099874:0:17089:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789583987.163548:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789583987.163573:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253807616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789583987.163654:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583987.164118:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253807744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789583987.164147:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583987.164251:0:16438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253807616 00000100:00100000:3.0:1789583987.164259:0:16438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253807616 00000100:00100000:3.0:1789583987.164306:0:16438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253807744 00000100:00100000:3.0:1789583987.164309:0:16438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253807744 00000100:00100000:3.0:1789583987.164325:0:16438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789583987.164333:0:16438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253807616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789583987.164373:0:16438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789583987.164424:0:16438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253807616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583987.164431:0:16438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789583987.164449:0:16438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789583987.164456:0:16438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253807744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789583987.164475:0:16438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789583987.164503:0:16438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253807744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583987.164510:0:16438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789583987.164546:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253807744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789583987.164558:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253807616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789583987.677003:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd0a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253807872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789583987.677090:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583987.677121:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfb450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876514253808384:0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.677147:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583987.677164:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3456:1876514253808896:0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.677183:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583987.677225:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789583987.677232:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd0a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3456:1876514253808000:0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.677257:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583987.677283:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253808512:0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.677305:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583987.677321:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253809024:0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.677340:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583987.677368:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd0a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253808128:0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.677391:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583987.677408:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253808640:0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.677429:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583987.677444:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3454:1876514253809152:0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.677464:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583987.677481:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789583987.677486:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd0a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253808256:0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.677505:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583987.677520:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876514253808768:0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.677540:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583987.677557:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3454:1876514253809280:0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.677589:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583987.677617:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253807872 00000100:00100000:2.0:1789583987.677624:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253807872 00000100:00100000:2.0:1789583987.677672:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789583987.677682:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253807872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789583987.677716:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583987.677760:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253807872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583987.677767:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789583987.677791:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253808384 00000100:00100000:2.0:1789583987.677795:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253808384 00000100:00100000:2.0:1789583987.677813:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253808896 00000100:00100000:2.0:1789583987.677815:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253808896 00000100:00100000:2.0:1789583987.677826:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253809024 00000100:00100000:2.0:1789583987.677828:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253809024 00000100:00100000:2.0:1789583987.677839:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253809152 00000100:00100000:2.0:1789583987.677841:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253809152 00000100:00100000:2.0:1789583987.677858:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253808768 00000100:00100000:2.0:1789583987.677860:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253808768 00000100:00100000:2.0:1789583987.677869:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253809280 00000100:00100000:2.0:1789583987.677871:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253809280 00000100:00100000:2.0:1789583987.677886:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789583987.677892:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876514253808384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.677924:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876514253808384:12345-0@lo:400:kworker.0 Request processed in 32us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583987.677931:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789583987.677943:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789583987.677949:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876514253808896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.677974:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876514253808896:12345-0@lo:400:kworker.0 Request processed in 26us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583987.677988:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789583987.678001:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789583987.678007:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876514253809024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.678037:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876514253809024:12345-0@lo:400:kworker.0 Request processed in 30us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583987.678055:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789583987.678067:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789583987.678074:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3454:x1876514253809152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.678104:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3454:x1876514253809152:12345-0@lo:400:kworker.0 Request processed in 31us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583987.678110:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789583987.678121:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789583987.678126:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876514253808768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.678147:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876514253808768:12345-0@lo:400:kworker.0 Request processed in 22us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583987.678152:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789583987.678162:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789583987.678167:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3454:x1876514253809280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583987.678537:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789583987.678548:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253809408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583987.678609:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3454:x1876514253809280:12345-0@lo:400:kworker.0 Request processed in 441us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583987.678616:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789583987.678641:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253808000 00000100:00100000:2.0:1789583987.678647:0:16426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253808000 00000100:00100000:2.0:1789583987.678672:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789583987.678678:0:16426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df5171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfd2e540-776d-4d6d-9d40-7d81c66add0c+24:3456:x1876514253808000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583987.679353:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583987.680306:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253809408 00000100:00100000:0.0:1789583987.680314:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253809408 00000100:00100000:0.0:1789583987.680352:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789583987.680367:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253809408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789583987.680842:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583987.680907:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253809408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 541us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583987.680914:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789583987.680965:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253809408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789583987.682296:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253808512 00000100:00100000:0.0:1789583987.682308:0:17747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253808512 00000100:00100000:0.0:1789583987.682343:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253808128 00000100:00100000:0.0:1789583987.682346:0:17747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253808128 00000100:00080000:1.0:1789583987.682354:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789583987.682356:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253808640 00000100:00080000:1.0:1789583987.682359:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789583987.682359:0:17747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253808640 00000100:00080000:1.0:1789583987.682362:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789583987.682365:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789583987.682449:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253808256 00000100:00100000:0.0:1789583987.682453:0:17747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253808256 00000100:00100000:1.0:1789583987.683702:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789583987.683721:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253808512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583987.683807:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253808512:12345-0@lo:400:kworker.0 Request processed in 94us (6500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583987.683814:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789583987.683835:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789583987.683842:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253808128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583987.683870:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253808128:12345-0@lo:400:kworker.0 Request processed in 29us (6479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583987.683877:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789583987.683887:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789583987.683893:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253808640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583987.683919:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253808640:12345-0@lo:400:kworker.0 Request processed in 25us (6489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583987.683925:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789583987.683964:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253808512:0@lo:400:kworker.0 00010000:00080000:1.0:1789583987.683980:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8df7818e00 x1876514253809024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583987.683991:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253809024:0@lo:400:kworker.0 00000100:00100000:1.0:1789583987.684032:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd0a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253807872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789583987.684058:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfb450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876514253808384:0@lo:400:kworker.0 00000100:00100000:1.0:1789583987.684161:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3456:1876514253808896:0@lo:400:kworker.0 00000100:00100000:0.0:1789583987.684516:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789583987.684525:0:17747:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253808256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583987.684562:0:17747:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253808256:12345-0@lo:400:kworker.0 Request processed in 40us (7057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583987.684569:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789583987.688733:0:16426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df5171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfd2e540-776d-4d6d-9d40-7d81c66add0c+24:3456:x1876514253808000:12345-0@lo:400:kworker.0 Request processed in 10045us (11465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583987.688748:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789583987.688880:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd0a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253808256:0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.688894:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876514253808768:0@lo:400:kworker.0 00010000:00080000:2.0:1789583987.688908:0:3454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8df7819500 x1876514253809280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583987.688920:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3454:1876514253809280:0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.688930:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd0a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253808128:0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.688941:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253808640:0@lo:400:kworker.0 00000100:00100000:2.0:1789583987.688952:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3454:1876514253809152:0@lo:400:kworker.0 00000100:00100000:1.0:1789583987.689042:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd0a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3456:1876514253808000:0@lo:400:kworker.0 00000100:00100000:1.0:1789583987.689076:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789583987.689085:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253809536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789583987.689124:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583987.689228:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253809536 00000100:00100000:2.0:1789583987.689236:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253809536 00000100:00100000:2.0:1789583987.689274:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789583987.689282:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253809536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789583987.689300:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583987.689342:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253809536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583987.689349:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789583987.689378:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253809536:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789583987.739519:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583988.763495:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583989.788870:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583990.418232:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583990.418269:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583990.418292:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583990.418309:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583990.418340:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583990.418364:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583990.418390:0:18217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228552960 00000100:00100000:1.0:1789583990.418399:0:18217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228552960 00000100:00100000:1.0:1789583990.418469:0:18217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 45 00000100:00100000:1.0:1789583990.418479:0:18217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+6:2402:x1876514228552960:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1789583990.418547:0:18217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+6:2402:x1876514228552960:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 70us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583990.418554:0:18217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 45 00000100:00100000:1.0:1789583990.418577:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228552832 00000100:00100000:1.0:1789583990.418580:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228552832 00000100:00100000:1.0:1789583990.418604:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228553088 00000100:00100000:1.0:1789583990.418607:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228553088 00000100:00100000:1.0:1789583990.418621:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228552704 00000100:00100000:1.0:1789583990.418637:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228552704 00000100:00100000:1.0:1789583990.418657:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228553216 00000100:00100000:1.0:1789583990.418658:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228553216 00000100:00100000:1.0:1789583990.418672:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 95 00000100:00100000:1.0:1789583990.418677:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+5:2402:x1876514228552832:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1789583990.418707:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+5:2402:x1876514228552832:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 30us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583990.418713:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 95 00000100:00100000:1.0:1789583990.418742:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 96 00000100:00100000:1.0:1789583990.418748:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+6:2402:x1876514228553088:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1789583990.418773:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+6:2402:x1876514228553088:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 25us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583990.418778:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 96 00000100:00100000:1.0:1789583990.418789:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 97 00000100:00100000:1.0:1789583990.418795:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+11:2402:x1876514228552704:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1789583990.418819:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+11:2402:x1876514228552704:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 24us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583990.418824:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 97 00000100:00100000:1.0:1789583990.418835:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 98 00000100:00100000:1.0:1789583990.418841:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+5:2402:x1876514228553216:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1789583990.418861:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+5:2402:x1876514228553216:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 21us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583990.418867:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 98 00000100:00080000:1.0:1789583990.418882:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789583990.418885:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789583990.418895:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789583990.419158:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228552576 00000100:00100000:3.0:1789583990.419163:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228552576 00000100:00100000:3.0:1789583990.419215:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 172 00000100:00100000:3.0:1789583990.419223:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df5170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b27b7af-4f39-4d86-bddb-f5b775fff529+13:2402:x1876514228552576:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789583990.419268:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df5170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b27b7af-4f39-4d86-bddb-f5b775fff529+13:2402:x1876514228552576:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 45us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583990.419275:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 172 00010000:00010000:1.0:1789583990.811443:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583991.771655:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789583991.771681:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253809664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789583991.771752:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583991.772058:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253809664 00000100:00100000:0.0:1789583991.772068:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253809664 00000100:00100000:0.0:1789583991.772140:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789583991.772150:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253809664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789583991.772184:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583991.772256:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253809664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583991.772263:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789583991.772416:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789583991.772454:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253809664:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789583991.835857:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583992.288774:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789583992.288797:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253809792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789583992.288865:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583992.288925:0:16438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253809792 00000100:00100000:3.0:1789583992.288933:0:16438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253809792 00000100:00100000:3.0:1789583992.288991:0:16438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789583992.289000:0:16438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253809792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789583992.289038:0:16438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789583992.289081:0:16438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253809792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583992.289088:0:16438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789583992.289127:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253809792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789583992.302423:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789583992.302450:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253809920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789583992.302529:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583992.302594:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253809920 00000100:00100000:0.0:1789583992.302601:0:16437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253809920 00000100:00100000:0.0:1789583992.302646:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789583992.302655:0:16437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253809920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789583992.302694:0:16437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789583992.302740:0:16437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253809920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583992.302747:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789583992.302790:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253809920:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1789583992.368667:0:20085:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 14:39:50 (1789583990) 00000100:00100000:1.0:1789583992.795751:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253810048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789583992.795827:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583992.795896:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253810048 00000100:00100000:1.0:1789583992.795904:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253810048 00000100:00100000:1.0:1789583992.795967:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789583992.795977:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253810048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789583992.796023:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583992.796084:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253810048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583992.796091:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789583992.796230:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253810048:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789583992.796522:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789583992.798647:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789583992.798668:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253810176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789583992.798723:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583992.798763:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253810176 00000100:00100000:1.0:1789583992.798769:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253810176 00000100:00100000:1.0:1789583992.798815:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789583992.798824:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253810176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789583992.798842:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583992.798881:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253810176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583992.798887:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789583992.798907:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789583992.798936:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253810176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789583992.799382:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3455:1876514253810304:0@lo:400:kworker.0 00000100:00100000:3.0:1789583992.799426:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583992.799467:0:16425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253810304 00000100:00100000:3.0:1789583992.799484:0:16425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253810304 00000100:00100000:3.0:1789583992.799512:0:16425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789583992.799519:0:16425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df5173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfd2e540-776d-4d6d-9d40-7d81c66add0c+24:3455:x1876514253810304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583992.799555:0:16425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df5173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfd2e540-776d-4d6d-9d40-7d81c66add0c+24:3455:x1876514253810304:12345-0@lo:400:kworker.0 Request processed in 37us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583992.799562:0:16425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789583992.799597:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3455:1876514253810304:0@lo:400:kworker.0 00000100:00100000:1.0:1789583992.799772:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd0a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3454:1876514253810688:0@lo:400:kworker.0 00000100:00100000:1.0:1789583992.799804:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583992.799823:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc5c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3454:1876514253811200:0@lo:400:kworker.0 00000100:00100000:1.0:1789583992.799843:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583992.799859:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789583992.799865:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd0a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253810816:0@lo:400:kworker.0 00000100:00100000:1.0:1789583992.799887:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583992.799906:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc5c01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3454:1876514253811328:0@lo:400:kworker.0 00000100:00100000:1.0:1789583992.799926:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583992.799962:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253810688 00000100:00100000:1.0:1789583992.799967:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253810688 00000100:00100000:1.0:1789583992.799993:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253811200 00000100:00100000:1.0:1789583992.799995:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253811200 00000100:00100000:1.0:1789583992.800015:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253811328 00000100:00100000:1.0:1789583992.800017:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253811328 00000100:00100000:1.0:1789583992.800031:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789583992.800036:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc5c01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3454:x1876514253810688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583992.800070:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc5c01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3454:x1876514253810688:12345-0@lo:400:kworker.0 Request processed in 33us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583992.800076:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789583992.800087:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789583992.800093:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc5c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3454:x1876514253811200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583992.800116:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc5c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3454:x1876514253811200:12345-0@lo:400:kworker.0 Request processed in 23us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583992.800121:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789583992.800131:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789583992.800137:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3454:x1876514253811328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583992.800175:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3454:x1876514253811328:12345-0@lo:400:kworker.0 Request processed in 39us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583992.800183:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789583992.800235:0:17344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253810816 00000100:00100000:1.0:1789583992.800240:0:17344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253810816 00000100:00100000:1.0:1789583992.800264:0:17344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789583992.800270:0:17344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc5c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253810816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583992.800984:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253810432:0@lo:400:kworker.0 00000100:00100000:3.0:1789583992.801023:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583992.801047:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd0a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253810944:0@lo:400:kworker.0 00000100:00100000:3.0:1789583992.801069:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583992.801088:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc5c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3456:1876514253811456:0@lo:400:kworker.0 00000100:00100000:3.0:1789583992.801109:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583992.801128:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789583992.801134:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfb450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253810560:0@lo:400:kworker.0 00000100:00100000:3.0:1789583992.801155:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583992.801172:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd0a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3456:1876514253811072:0@lo:400:kworker.0 00000100:00100000:3.0:1789583992.801208:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583992.801224:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc5c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3456:1876514253811584:0@lo:400:kworker.0 00000100:00100000:3.0:1789583992.801243:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583992.801266:0:16438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253810432 00000100:00100000:3.0:1789583992.801271:0:16438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253810432 00000100:00100000:0.0:1789583992.801501:0:17744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253810944 00000100:00100000:0.0:1789583992.801506:0:17744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253810944 00000100:00100000:0.0:1789583992.801536:0:17744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253810560 00000100:00100000:0.0:1789583992.801539:0:17744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253810560 00000100:00100000:1.0:1789583992.801583:0:17344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc5c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253810816:12345-0@lo:400:kworker.0 Request processed in 1132us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583992.804891:0:16438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789583992.804920:0:16438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253810432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583992.805032:0:16438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253810432:12345-0@lo:400:kworker.0 Request processed in 126us (4008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583992.805274:0:17344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789583992.805337:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253811456 00000100:00100000:1.0:1789583992.805346:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253811456 00000100:00100000:1.0:1789583992.805379:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253811072 00000100:00100000:1.0:1789583992.805383:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253811072 00000100:00100000:1.0:1789583992.805396:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253811584 00000100:00100000:1.0:1789583992.805398:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253811584 00000100:00100000:1.0:1789583992.805526:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789583992.805534:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3456:x1876514253811456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583992.805574:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3456:x1876514253811456:12345-0@lo:400:kworker.0 Request processed in 42us (4464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583992.805581:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789583992.805594:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789583992.805601:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3456:x1876514253811072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583992.805629:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3456:x1876514253811072:12345-0@lo:400:kworker.0 Request processed in 29us (4419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583992.805634:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789583992.805647:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789583992.805662:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3456:x1876514253811584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583992.805707:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3456:x1876514253811584:12345-0@lo:400:kworker.0 Request processed in 46us (4463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583992.805713:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789583992.805796:0:17744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789583992.805809:0:17744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253810944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583992.805846:0:17744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253810944:12345-0@lo:400:kworker.0 Request processed in 41us (4775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583992.805886:0:16438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789583992.810604:0:18217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789583992.810635:0:18217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253810560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583992.810732:0:18217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253810560:12345-0@lo:400:kworker.0 Request processed in 114us (9576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583992.810740:0:18217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789583992.810788:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789583992.810794:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789583992.810797:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583992.810834:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd0a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253810816:0@lo:400:kworker.0 00010000:00080000:1.0:1789583992.810851:0:3454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8cc5c01500 x1876514253811328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583992.810862:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc5c01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3454:1876514253811328:0@lo:400:kworker.0 00000100:00100000:1.0:1789583992.810875:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd0a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3454:1876514253810688:0@lo:400:kworker.0 00000100:00100000:1.0:1789583992.810886:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc5c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3454:1876514253811200:0@lo:400:kworker.0 00000100:00100000:0.0:1789583992.811684:0:17744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789583992.813312:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253811712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583992.813384:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583992.813598:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253811712 00000100:00100000:0.0:1789583992.813606:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253811712 00000100:00100000:0.0:1789583992.813657:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789583992.813667:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253811712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789583992.813690:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583992.813755:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253811712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583992.813762:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789583992.813805:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253811712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583992.816022:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfb450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253810560:0@lo:400:kworker.0 00000100:00100000:3.0:1789583992.816041:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd0a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3456:1876514253811072:0@lo:400:kworker.0 00010000:00080000:3.0:1789583992.816055:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8cc5c03800 x1876514253811584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583992.816066:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc5c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3456:1876514253811584:0@lo:400:kworker.0 00000100:00100000:3.0:1789583992.816079:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253810432:0@lo:400:kworker.0 00000100:00100000:3.0:1789583992.816090:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd0a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253810944:0@lo:400:kworker.0 00000100:00100000:3.0:1789583992.816101:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc5c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3456:1876514253811456:0@lo:400:kworker.0 00010000:00010000:1.0:1789583992.862298:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583993.883720:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789583994.590714:0:16468:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789583994.590725:0:16468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789583994.590759:0:16468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789583994.590779:0:16468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789583994.908239:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583995.547083:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583995.547260:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789583995.547996:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228553472 00000100:00100000:2.0:1789583995.548017:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228553472 00000100:00100000:2.0:1789583995.548095:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 105 00000100:00100000:2.0:1789583995.548108:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+11:2400:x1876514228553472:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1789583995.548214:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+11:2400:x1876514228553472:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 84us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583995.548221:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 105 00000100:00100000:3.0:1789583995.549385:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228553344 00000100:00100000:3.0:1789583995.549395:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228553344 00000100:00100000:3.0:1789583995.549447:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 174 00000100:00100000:3.0:1789583995.549456:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df5173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b27b7af-4f39-4d86-bddb-f5b775fff529+13:2399:x1876514228553344:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789583995.549502:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df5173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b27b7af-4f39-4d86-bddb-f5b775fff529+13:2399:x1876514228553344:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 47us (2429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583995.549509:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 174 00000100:00080000:1.0:1789583995.549848:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583995.575533:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583995.575585:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583995.575619:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789583995.575735:0:18217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228553728 00000100:00100000:2.0:1789583995.575745:0:18217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228553728 00000100:00100000:2.0:1789583995.575822:0:18217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00100000:2.0:1789583995.575834:0:18217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+6:2400:x1876514228553728:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1789583995.575918:0:18217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+6:2400:x1876514228553728:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 87us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583995.575926:0:18217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00080000:2.0:1789583995.575975:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789583995.576556:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789583995.589014:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228553984 00000100:00100000:3.0:1789583995.589047:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228553984 00000100:00100000:3.0:1789583995.589157:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228553600 00000100:00100000:3.0:1789583995.589161:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228553600 00000100:00100000:3.0:1789583995.589221:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228553856 00000100:00100000:3.0:1789583995.589225:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228553856 00000100:00100000:3.0:1789583995.589256:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 106 00000100:00100000:3.0:1789583995.589280:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+5:2400:x1876514228553984:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789583995.589382:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+5:2400:x1876514228553984:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 103us (13795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583995.589389:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 106 00000100:00100000:3.0:1789583995.589421:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 107 00000100:00100000:3.0:1789583995.589428:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+5:2400:x1876514228553600:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789583995.589453:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+5:2400:x1876514228553600:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 27us (13835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583995.589459:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 107 00000100:00100000:3.0:1789583995.589472:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 108 00000100:00100000:3.0:1789583995.589479:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+6:2400:x1876514228553856:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789583995.589505:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+6:2400:x1876514228553856:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 27us (12950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583995.589511:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 108 00000100:00080000:3.0:1789583995.589561:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789583995.589565:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789583995.932539:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583996.367298:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789583996.367343:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789583996.367397:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583996.367497:0:16419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228554112 00000100:00100000:1.0:1789583996.367507:0:16419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228554112 00000100:00100000:1.0:1789583996.367582:0:16419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228554368 00000100:00100000:1.0:1789583996.367585:0:16419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228554368 00000100:00100000:1.0:1789583996.367613:0:16419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:1.0:1789583996.367623:0:16419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b27b7af-4f39-4d86-bddb-f5b775fff529+14:2399:x1876514228554112:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583996.367638:0:16419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583996.367656:0:16419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df52e7400/0x113b6add9f868e14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92edfc8 expref: 14 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583996.367674:0:16419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583996.367726:0:16419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b27b7af-4f39-4d86-bddb-f5b775fff529+13:2399:x1876514228554112:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 105us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583996.367734:0:16419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:1.0:1789583996.367783:0:16419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:1.0:1789583996.367789:0:16419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7818000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b27b7af-4f39-4d86-bddb-f5b775fff529+12:2402:x1876514228554368:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583996.367797:0:16419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583996.367819:0:16419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8dee6f5a00/0x113b6add9f868ea0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee0af expref: 12 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583996.367841:0:16419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583996.367859:0:16419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7818000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b27b7af-4f39-4d86-bddb-f5b775fff529+11:2402:x1876514228554368:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 71us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583996.367865:0:16419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:3.0:1789583996.368308:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228554624 00000100:00100000:3.0:1789583996.368314:0:17747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228554624 00000100:00100000:3.0:1789583996.368354:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:3.0:1789583996.368361:0:17747:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+6:2398:x1876514228554624:12345-192.168.204.11@tcp:9:umount.0 00000020:00000080:3.0:1789583996.368390:0:17747:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868e37 00000020:00010000:3.0:1789583996.368399:0:17747:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8f8cc4af0000: total 0 00000100:00080000:3.0:1789583996.368404:0:17747:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4af4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789583996.368443:0:17747:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1789583996.368729:0:17747:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+4:2398:x1876514228554624:12345-192.168.204.11@tcp:9:umount.0 Request processed in 367us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583996.368744:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 34 00000020:00010000:1.0:1789583996.369135:0:16420:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8f8cc4af0000: total 0 00010000:00010000:1.0:1789583996.369140:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583996.369167:0:16420:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f8cc4af0000, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1789583996.369227:0:16420:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789583996.369231:0:16420:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1789583974 -> 1789583975 00002000:00010000:1.0:1789583996.369234:0:16420:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789583974 -> 1789583975 00002000:00010000:1.0:1789583996.369236:0:16420:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1789583996.369257:0:16420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070ae3ccb/0x113b6add9f86919b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee188 expref: 3 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583996.369280:0:16420:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f8cc4af0000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789583996.369289:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583996.369291:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583996.369293:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583996.370481:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583996.370613:0:16419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228554240 00000100:00100000:1.0:1789583996.370621:0:16419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228554240 00000100:00100000:1.0:1789583996.370673:0:16419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:1.0:1789583996.370683:0:16419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b27b7af-4f39-4d86-bddb-f5b775fff529+11:2399:x1876514228554240:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583996.370696:0:16419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583996.370711:0:16419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df52e6e00/0x113b6add9f868e1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92edff9 expref: 11 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583996.370740:0:16419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583996.370793:0:16419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b27b7af-4f39-4d86-bddb-f5b775fff529+10:2399:x1876514228554240:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 110us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583996.370800:0:16419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:2.0:1789583996.381667:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789583996.381763:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228555520 00000100:00100000:3.0:1789583996.381774:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228555520 00000100:00100000:3.0:1789583996.381845:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 74 00000100:00100000:3.0:1789583996.381854:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+11:2398:x1876514228555520:12345-192.168.204.11@tcp:39:umount.0 00000020:00000080:3.0:1789583996.381903:0:16433:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868e29 00000020:00010000:3.0:1789583996.381919:0:16433:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8f8cc6c86800: total 0 00000100:00080000:3.0:1789583996.381924:0:16433:0:(import.c:65:import_set_state_nolock()) ffff8f8cc6c85800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789583996.381954:0:16433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:3.0:1789583996.382387:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+10:2398:x1876514228555520:12345-192.168.204.11@tcp:39:umount.0 Request processed in 532us (728us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1789583996.382396:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 74 00000020:00010000:1.0:1789583996.382754:0:16421:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8f8cc6c86800: total 0 00010000:00010000:1.0:1789583996.382796:0:16421:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f8cc6c86800, canceled 0 locks, left on hash table 6. 00010000:00010000:1.0:1789583996.382825:0:16421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8de16e9200) 00010000:00010000:1.0:1789583996.382829:0:16421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583996.382837:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8cc48c0c00/0x113b6add9f868f10 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee0bd expref: 9 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583996.382861:0:16421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8de85b4300) 00010000:00010000:1.0:1789583996.382863:0:16421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789583996.382868:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fe00/0x113b6add9f868f4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee0cb expref: 8 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583996.382903:0:16421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f8de85b4c00) 00010000:00010000:1.0:1789583996.382906:0:16421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789583996.382910:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f869147 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee165 expref: 7 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583996.382927:0:16421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f8dda0a5f00) 00010000:00010000:1.0:1789583996.382929:0:16421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789583996.382934:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dee6f5000/0x113b6add9f868ef4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee0b6 expref: 6 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583996.382948:0:16421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f8dc785de00) 00010000:00010000:1.0:1789583996.382964:0:16421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789583996.382970:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dee6f4800/0x113b6add9f868fd4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee0f5 expref: 5 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583996.382990:0:16421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f8dda0a5000) 00010000:00010000:1.0:1789583996.382992:0:16421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789583996.382996:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8cc48c0800/0x113b6add9f8690ec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee150 expref: 4 pid: 18999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583996.383009:0:16421:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f8cc6c86800, canceled 6 locks, left on hash table 0. 00010000:00010000:1.0:1789583996.383022:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583996.383024:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583996.383025:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583996.396165:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789583996.396443:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228555648 00000100:00100000:3.0:1789583996.396455:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228555648 00000100:00100000:3.0:1789583996.396514:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 75 00000100:00100000:3.0:1789583996.396524:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+5:2398:x1876514228555648:12345-192.168.204.11@tcp:39:umount.0 00000020:00000080:3.0:1789583996.396558:0:18945:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868e30 00000100:00080000:3.0:1789583996.396575:0:18945:0:(import.c:65:import_set_state_nolock()) ffff8f8dc69ba000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789583996.396606:0:18945:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1789583996.396909:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583996.397437:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311+3:2398:x1876514228555648:12345-192.168.204.11@tcp:39:umount.0 Request processed in 911us (1281us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789583996.397446:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 75 00000100:00100000:1.0:1789583996.892544:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253811840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789583996.892615:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583996.893106:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253811840 00000100:00100000:0.0:1789583996.893115:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253811840 00000100:00100000:0.0:1789583996.893176:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789583996.893208:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253811840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789583996.893241:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583996.893289:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253811840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583996.893296:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789583996.894416:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253811840:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789583996.896221:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1789583996.937707:0:8131:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311 00000020:00000080:1.0:1789583996.937719:0:8131:0:(genops.c:885:class_export_put()) final put ffff8f8cc4af0000/274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311 00000020:00000080:3.0:1789583996.938225:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc4af0000/274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311 for lustre-OST0000 00000020:00000080:3.0:1789583996.938299:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8cc4af4000 for lustre-OST0000 00010000:00010000:1.0:1789583996.956219:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789583997.341663:0:17089:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789583997.404152:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789583997.404176:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253811968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789583997.404273:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583997.404557:0:17344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253811968 00000100:00100000:0.0:1789583997.404564:0:17344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253811968 00000100:00100000:0.0:1789583997.404615:0:17344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789583997.404625:0:17344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253811968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789583997.404665:0:17344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789583997.404727:0:17344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253811968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583997.404735:0:17344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789583997.404831:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253811968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789583997.405783:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253812096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789583997.405826:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583997.405983:0:16438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253812096 00000100:00100000:0.0:1789583997.405989:0:16438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253812096 00000100:00100000:0.0:1789583997.406027:0:16438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789583997.406034:0:16438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253812096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789583997.406063:0:16438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789583997.406114:0:16438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253812096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583997.406138:0:16438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789583997.409925:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253812096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789583997.919881:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253812352:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.919950:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583997.920006:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253812864:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920030:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583997.920063:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfc88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3455:1876514253813376:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920091:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583997.920116:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1789583997.920122:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3455:1876514253812224:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920149:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583997.920167:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876514253812736:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920209:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583997.920226:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876514253813248:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920246:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583997.920259:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3455:1876514253813760:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920274:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583997.920300:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253813376 00000100:00100000:1.0:1789583997.920307:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253813376 00000100:00100000:1.0:1789583997.920353:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253812736 00000100:00100000:1.0:1789583997.920357:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253812736 00000100:00100000:1.0:1789583997.920370:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253813248 00000100:00100000:1.0:1789583997.920373:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253813248 00000100:00100000:1.0:1789583997.920383:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253813760 00000100:00100000:1.0:1789583997.920385:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253813760 00000100:00100000:1.0:1789583997.920399:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789583997.920407:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc5c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876514253813376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920459:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc5c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876514253813376:12345-0@lo:400:kworker.0 Request processed in 52us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583997.920467:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789583997.920484:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789583997.920490:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc5c01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876514253812736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920530:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc5c01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876514253812736:12345-0@lo:400:kworker.0 Request processed in 40us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583997.920544:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789583997.920559:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789583997.920565:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876514253813248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920594:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876514253813248:12345-0@lo:400:kworker.0 Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583997.920600:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789583997.920611:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789583997.920617:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd0a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876514253813760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920643:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd0a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876514253813760:12345-0@lo:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583997.920649:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789583997.920667:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253812352 00000100:00100000:1.0:1789583997.920670:0:16437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253812352 00000100:00100000:1.0:1789583997.920692:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253812864 00000100:00100000:1.0:1789583997.920694:0:16437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253812864 00000100:00100000:1.0:1789583997.920706:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789583997.920712:0:16437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc5c01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253812352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920740:0:16437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc5c01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253812352:12345-0@lo:400:kworker.0 Request processed in 28us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583997.920746:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789583997.920758:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789583997.920763:0:16437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc5c03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253812864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920788:0:16437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc5c03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253812864:12345-0@lo:400:kworker.0 Request processed in 25us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583997.920793:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789583997.920816:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253812480:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920843:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583997.920875:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253812992:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920896:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583997.920909:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253813504:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920926:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583997.920942:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789583997.920947:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253812608:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920964:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583997.920976:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253813120:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.920994:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583997.921010:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3456:1876514253813632:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921028:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583997.921046:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253812480 00000100:00100000:1.0:1789583997.921050:0:17746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253812480 00000100:00100000:1.0:1789583997.921070:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253812992 00000100:00100000:1.0:1789583997.921073:0:17746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253812992 00000100:00100000:1.0:1789583997.921082:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253812608 00000100:00100000:1.0:1789583997.921084:0:17746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253812608 00000100:00100000:1.0:1789583997.921094:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253813120 00000100:00100000:1.0:1789583997.921096:0:17746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253813120 00000100:00100000:1.0:1789583997.921108:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789583997.921114:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253812480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921150:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253812480:12345-0@lo:400:kworker.0 Request processed in 36us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583997.921155:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789583997.921167:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789583997.921180:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253812992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921233:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253812992:12345-0@lo:400:kworker.0 Request processed in 55us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583997.921240:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789583997.921251:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789583997.921258:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253812608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921282:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253812608:12345-0@lo:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583997.921287:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789583997.921297:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789583997.921301:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253813120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921324:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253813120:12345-0@lo:400:kworker.0 Request processed in 23us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583997.921330:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789583997.921368:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253812608:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921378:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253813120:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921385:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253812480:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921393:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253812992:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921416:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253813504 00000100:00100000:1.0:1789583997.921419:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253813504 00000100:00100000:1.0:1789583997.921436:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253813632 00000100:00100000:1.0:1789583997.921439:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253813632 00000100:00100000:1.0:1789583997.921450:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789583997.921455:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876514253813504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921498:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876514253813504:12345-0@lo:400:kworker.0 Request processed in 42us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583997.921505:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789583997.921525:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789583997.921532:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3456:x1876514253813632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921557:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3456:x1876514253813632:12345-0@lo:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583997.921562:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789583997.921582:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3456:1876514253813632:0@lo:400:kworker.0 00010000:00080000:1.0:1789583997.921594:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8defc77480 x1876514253813504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583997.921603:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253813504:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921628:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876514253812736:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921641:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876514253813248:0@lo:400:kworker.0 00010000:00080000:1.0:1789583997.921652:0:3455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dc4eed880 x1876514253813760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583997.921661:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3455:1876514253813760:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921673:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253812352:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921686:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253812864:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921699:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfc88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3455:1876514253813376:0@lo:400:kworker.0 00000100:00100000:1.0:1789583997.921723:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253813888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789583997.921756:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583997.921862:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253813888 00000100:00100000:2.0:1789583997.921869:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253813888 00000100:00100000:2.0:1789583997.921912:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789583997.921920:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253813888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789583997.921951:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583997.921994:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253813888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583997.922000:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789583997.922035:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253813888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789583997.923018:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253812224 00000100:00100000:3.0:1789583997.923033:0:16426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253812224 00000100:00100000:3.0:1789583997.923067:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789583997.923075:0:16426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df5170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfd2e540-776d-4d6d-9d40-7d81c66add0c+24:3455:x1876514253812224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583997.923127:0:16426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df5170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfd2e540-776d-4d6d-9d40-7d81c66add0c+24:3455:x1876514253812224:12345-0@lo:400:kworker.0 Request processed in 53us (2977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583997.923133:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:3.0:1789583997.923174:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789583997.923178:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789583997.923182:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789583997.923184:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583997.923223:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253814016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789583997.923251:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583997.923286:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253814016 00000100:00100000:3.0:1789583997.923290:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253814016 00000100:00100000:3.0:1789583997.923308:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789583997.923314:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfb450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253814016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789583997.923327:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583997.923357:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfb450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253814016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583997.923363:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789583997.923396:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253814016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789583997.923612:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3455:1876514253812224:0@lo:400:kworker.0 00000100:00100000:3.0:1789583997.923902:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789583997.923913:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253814144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583997.923958:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583997.924054:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253814144 00000100:00100000:0.0:1789583997.924059:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253814144 00000100:00100000:0.0:1789583997.924081:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789583997.924087:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253814144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789583997.924099:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583997.924147:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253814144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583997.924153:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789583997.925598:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253814144:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789583997.981550:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789583998.020110:0:7262:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311 00000001:00080000:0.0:1789583998.020129:0:7262:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1789583998.020136:0:7262:0:(genops.c:885:class_export_put()) final put ffff8f8cc6c87800/274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311 00000020:00000080:2.0:1789583998.020448:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc6c87800/274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311 for lustre-MDT0001 00000020:00000080:2.0:1789583998.020587:0:12001:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8dc69ba000 for lustre-MDT0001 00000100:00100000:0.0:1789583998.768235:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789583998.768594:0:16417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228555776 00000100:00100000:2.0:1789583998.768609:0:16417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228555776 00000100:00100000:2.0:1789583998.768702:0:16417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:2.0:1789583998.768716:0:16417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b27b7af-4f39-4d86-bddb-f5b775fff529+10:2399:x1876514228555776:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583998.768738:0:16417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583998.768766:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df52e6400/0x113b6add9f868e53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee038 expref: 10 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583998.768788:0:16417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583998.768874:0:16417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b27b7af-4f39-4d86-bddb-f5b775fff529+9:2399:x1876514228555776:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 161us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583998.768882:0:16417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:0.0:1789583998.769146:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789583998.770466:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789583998.770624:0:16418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228556032 00000100:00100000:3.0:1789583998.770653:0:16418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228556032 00000100:00100000:3.0:1789583998.770723:0:16418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228555904 00000100:00100000:3.0:1789583998.770727:0:16418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228555904 00000100:00100000:3.0:1789583998.770754:0:16418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:3.0:1789583998.770763:0:16418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b27b7af-4f39-4d86-bddb-f5b775fff529+10:2401:x1876514228556032:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583998.770779:0:16418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583998.770800:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8dee6f5200/0x113b6add9f868e99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee0a8 expref: 10 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583998.770838:0:16418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583998.770894:0:16418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b27b7af-4f39-4d86-bddb-f5b775fff529+9:2401:x1876514228556032:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 132us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583998.770902:0:16418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:3.0:1789583998.770935:0:16418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:3.0:1789583998.770942:0:16418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b27b7af-4f39-4d86-bddb-f5b775fff529+8:2399:x1876514228555904:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583998.770951:0:16418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583998.770961:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df52e6200/0x113b6add9f868e5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee069 expref: 8 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583998.770971:0:16418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583998.770990:0:16418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b27b7af-4f39-4d86-bddb-f5b775fff529+7:2399:x1876514228555904:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 48us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583998.770996:0:16418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:1.0:1789583998.782163:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789583998.782402:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228556288 00000100:00100000:2.0:1789583998.782437:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228556288 00000100:00100000:2.0:1789583998.782547:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 76 00000100:00080000:3.0:1789583998.782706:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583998.782752:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+6:2398:x1876514228556288:12345-192.168.204.11@tcp:39:umount.0 00000020:00000080:2.0:1789583998.782812:0:18999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868e68 00000020:00010000:2.0:1789583998.782823:0:18999:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8f8cc5473000: total 0 00000100:00080000:2.0:1789583998.782840:0:18999:0:(import.c:65:import_set_state_nolock()) ffff8f8cc5473800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789583998.782879:0:18999:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00010000:1.0:1789583998.783251:0:16421:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8f8cc5473000: total 0 00010000:00010000:1.0:1789583998.783257:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583998.783321:0:16421:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f8cc5473000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789583998.783365:0:16421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8de85b4300) 00010000:00010000:1.0:1789583998.783370:0:16421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789583998.783380:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f868f5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee0d2 expref: 5 pid: 18999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583998.783411:0:16421:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f8cc5473000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789583998.783421:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583998.783423:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583998.783424:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583998.784118:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+3:2398:x1876514228556288:12345-192.168.204.11@tcp:39:umount.0 Request processed in 1366us (1962us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1789583998.784131:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 76 00000100:00100000:0.0:1789583998.794260:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789583998.794392:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228556416 00000100:00100000:2.0:1789583998.794405:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228556416 00000100:00100000:2.0:1789583998.794523:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 77 00000100:00100000:2.0:1789583998.794538:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+5:2398:x1876514228556416:12345-192.168.204.11@tcp:39:umount.0 00000020:00000080:2.0:1789583998.794600:0:16434:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868e6f 00000100:00080000:2.0:1789583998.794614:0:16434:0:(import.c:65:import_set_state_nolock()) ffff8f8e01e76000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789583998.794646:0:16434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1789583998.795128:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74c62c8b-20fd-4180-b5fa-7ba19c1807c1+3:2398:x1876514228556416:12345-192.168.204.11@tcp:39:umount.0 Request processed in 592us (879us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789583998.795139:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 77 00000100:00080000:3.0:1789583998.795476:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789583998.795666:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583998.842011:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789583998.842903:0:16425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228556672 00000100:00100000:2.0:1789583998.842919:0:16425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228556672 00000100:00100000:2.0:1789583998.842998:0:16425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 176 00000100:00100000:2.0:1789583998.843012:0:16425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df5173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b27b7af-4f39-4d86-bddb-f5b775fff529+7:2398:x1876514228556672:12345-192.168.204.11@tcp:251:umount.0 00000020:00000080:2.0:1789583998.843080:0:16425:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868e06 00000020:00010000:2.0:1789583998.843092:0:16425:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8f8cc6c83800: total 0 00000100:00080000:2.0:1789583998.843100:0:16425:0:(import.c:65:import_set_state_nolock()) ffff8f8cc6c87000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789583998.843284:0:16425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df5173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b27b7af-4f39-4d86-bddb-f5b775fff529+3:2398:x1876514228556672:12345-192.168.204.11@tcp:251:umount.0 Request processed in 274us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583998.843307:0:16425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 176 00000020:00010000:1.0:1789583998.845730:0:16421:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8f8cc6c83800: total 0 00010000:00010000:1.0:1789583998.845813:0:16421:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f8cc6c83800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789583998.845879:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df52e6000/0x113b6add9f868e0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92edfc1 expref: 2 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583998.845903:0:16421:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f8cc6c83800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789583998.845914:0:16421:0:(genops.c:885:class_export_put()) final put ffff8f8cc6c83800/9b27b7af-4f39-4d86-bddb-f5b775fff529 00010000:00010000:1.0:1789583998.845943:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583998.845946:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583998.845948:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789583998.846731:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc6c83800/9b27b7af-4f39-4d86-bddb-f5b775fff529 for MGS 00000020:00000080:2.0:1789583998.846796:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8cc6c87000 for MGS 00010000:00010000:1.0:1789583999.005921:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584000.029431:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789584000.566704:0:6470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 74c62c8b-20fd-4180-b5fa-7ba19c1807c1 00000001:00080000:1.0:1789584000.566720:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:1.0:1789584000.566726:0:6470:0:(genops.c:885:class_export_put()) final put ffff8f8cc5473000/74c62c8b-20fd-4180-b5fa-7ba19c1807c1 00000001:00100000:1.0:1789584000.566743:0:6470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311 00000001:00080000:1.0:1789584000.566749:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:1.0:1789584000.566766:0:6470:0:(genops.c:885:class_export_put()) final put ffff8f8cc6c86800/274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311 00000020:00000080:2.0:1789584000.567381:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc5473000/74c62c8b-20fd-4180-b5fa-7ba19c1807c1 for lustre-MDT0000 00000020:00000080:2.0:1789584000.567446:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc6c86800/274cfb6c-9ce3-49ad-ab4e-bcb22c6ed311 for lustre-MDT0000 00000020:00000080:2.0:1789584000.567474:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8cc5473800 for lustre-MDT0000 00000020:00000080:2.0:1789584000.567479:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8cc6c85800 for lustre-MDT0000 00000020:01000004:1.0:1789584000.857742:0:20284:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789584000.890450:0:20284:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789584000.890500:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8defc5f600/0x113b6add9f8689c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8689d0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.890515:0:20284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8defc5f600/0x113b6add9f8689c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f8689d0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.890523:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8defc5f600/0x113b6add9f8689c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f8689d0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.890530:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8defc5f600/0x113b6add9f8689c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f8689d0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.890569:0:20284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789584000.890575:0:20284:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789584000.890596:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789584000.890601:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789584000.890607:0:20284:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789584000.890633:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8f8dee198000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789584000.890685:0:16420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584000.890693:0:16420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8defc5f600/0x113b6add9f8689c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f8689d0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584000.890707:0:16420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5f600 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:3.0:1789584000.890710:0:16420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8defc5f600/0x113b6add9f8689c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f8689d0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584000.890719:0:16420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8defc5f600/0x113b6add9f8689c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f8689d0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789584000.890726:0:16420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8defc5f600/0x113b6add9f8689c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f8689d0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789584000.890732:0:16420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789584000.890734:0:16420:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789584000.890736:0:16420:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789584000.890762:0:16420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8defc5f600/0x113b6add9f8689c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f8689d0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584000.890769:0:16420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789584000.890805:0:16420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8defc5f600/0x113b6add9f8689c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f8689d0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584000.890813:0:16420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8defc5f600/0x113b6add9f8689c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f8689d0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584000.890824:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584000.890826:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584000.890828:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584000.890835:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789584000.890852:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3455:1876514253814400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789584000.890914:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584000.891102:0:16418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253814400 00000100:00100000:1.0:1789584000.891109:0:16418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253814400 00000100:00100000:1.0:1789584000.891163:0:16418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789584000.891173:0:16418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfac2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfd2e540-776d-4d6d-9d40-7d81c66add0c+24:3455:x1876514253814400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789584000.891213:0:16418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789584000.891228:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8defc5fa00/0x113b6add9f8689d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f8689c9 expref: 24 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.891241:0:16418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789584000.891341:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3455:1876514253814400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789584000.892052:0:16418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfac2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfd2e540-776d-4d6d-9d40-7d81c66add0c+23:3455:x1876514253814400:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584000.892064:0:16418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789584000.892303:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876514253814272:0@lo:39:umount.0 00000100:00100000:3.0:1789584000.892344:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584000.892550:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253814272 00000100:00100000:0.0:1789584000.892555:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253814272 00000100:00100000:0.0:1789584000.892600:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789584000.892609:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfac2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876514253814272:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789584000.892653:0:18945:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f8689fa 00000100:00080000:0.0:1789584000.892662:0:18945:0:(import.c:65:import_set_state_nolock()) ffff8f8dd1dbb800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789584000.892726:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfac2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3453:x1876514253814272:12345-0@lo:39:umount.0 Request processed in 118us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584000.892733:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000020:00000080:0.0:1789584000.892741:0:18945:0:(genops.c:885:class_export_put()) final put ffff8f8dd1dbf000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789584000.892765:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dd1dbf000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789584000.892822:0:12001:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8dd1dbb800 for lustre-MDT0000 00010000:00010000:3.0:1789584000.892864:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789584000.892888:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dee198000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789584000.892905:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876514253814272:0@lo:39:umount.0 00000100:00080000:0.0:1789584000.893816:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789584000.893821:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789584000.893825:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789584000.894765:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9800/0x113b6add9f86891a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f868921 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894781:0:20284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9800/0x113b6add9f86891a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f868921 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894816:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9800/0x113b6add9f86891a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868921 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894823:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9800/0x113b6add9f86891a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868921 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894844:0:20284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789584000.894851:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df52e6a00/0x113b6add9f868d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f868d34 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894858:0:20284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df52e6a00/0x113b6add9f868d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f868d34 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894864:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df52e6a00/0x113b6add9f868d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868d34 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894870:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8df52e6a00/0x113b6add9f868d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868d34 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894889:0:20284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789584000.894896:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e200/0x113b6add9f868ed1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f868ed8 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894903:0:20284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e200/0x113b6add9f868ed1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f868ed8 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894909:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e200/0x113b6add9f868ed1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868ed8 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.894917:0:16421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789584000.894924:0:16421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9800/0x113b6add9f86891a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868921 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894925:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e200/0x113b6add9f868ed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868ed8 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.894932:0:16421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe9800 already unused, calling callback (ffffffffc1befc20) 00010000:00010000:0.0:1789584000.894933:0:20284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:00010000:1.0:1789584000.894936:0:16421:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9800/0x113b6add9f86891a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868921 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894938:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86890c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f868913 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894945:0:20284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86890c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f868913 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.894946:0:16421:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9800/0x113b6add9f86891a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868921 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894952:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86890c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868913 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894958:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86890c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868913 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789584000.894962:0:16421:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9800/0x113b6add9f86891a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868921 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584000.894964:0:20284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1789584000.894967:0:20284:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:01000000:1.0:1789584000.894968:0:16421:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:01000004:0.0:1789584000.894989:0:20284:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789584000.894993:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789584000.894996:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789584000.895001:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:0.0:1789584000.895007:0:20284:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8f8cc44b8000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789584000.895012:0:20284:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8f8df623e800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789584000.895016:0:20284:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8f8df623b000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789584000.895021:0:20284:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8f8dc7da6800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789584000.895026:0:20284:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8f8df72c19c0) has exports, disconnecting them 00000020:00080000:0.0:1789584000.895036:0:20284:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f8cc44b8000), last request at 1789583997 10000000:01000000:1.0:1789584000.895037:0:16421:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1789584000.895040:0:16421:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00000080:0.0:1789584000.895042:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868c4d 00000100:00080000:0.0:1789584000.895058:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8f8cc44bb800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789584000.895069:0:16421:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9800/0x113b6add9f86891a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868921 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.895075:0:16421:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1789584000.895098:0:20284:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8cc44b8000): rc 0 00000020:00000080:0.0:1789584000.895101:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8cc44b8000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1789584000.895108:0:16421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9800/0x113b6add9f86891a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868921 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789584000.895109:0:20284:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f8df623e800), last request at 1789583997 00000020:00000080:0.0:1789584000.895112:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868b97 00010000:00010000:1.0:1789584000.895115:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9800/0x113b6add9f86891a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868921 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789584000.895116:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8f8df623b800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789584000.895122:0:20284:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8df623e800): rc 0 00000020:00000080:0.0:1789584000.895124:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8df623e800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1789584000.895126:0:16421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789584000.895129:0:16421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8df52e6a00/0x113b6add9f868d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868d34 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789584000.895129:0:20284:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f8df623b000), last request at 1789583915 00000020:00000080:0.0:1789584000.895131:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868ae8 00000100:00080000:0.0:1789584000.895134:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8f8df6239000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789584000.895135:0:16421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df52e6a00 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:1.0:1789584000.895138:0:16421:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8df52e6a00/0x113b6add9f868d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868d34 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789584000.895138:0:20284:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8df623b000): rc 0 00000020:00000080:0.0:1789584000.895140:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8df623b000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1789584000.895144:0:20284:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f8dc7da6800), last request at 1789583915 00010000:00010000:1.0:1789584000.895145:0:16421:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8df52e6a00/0x113b6add9f868d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868d34 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789584000.895147:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868a8d 00000100:00080000:0.0:1789584000.895150:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8f8dc7da5000 : changing import state from FULL to CLOSED 10000000:00010000:1.0:1789584000.895152:0:16421:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8df52e6a00/0x113b6add9f868d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868d34 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1789584000.895155:0:20284:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 10000000:01000000:1.0:1789584000.895166:0:16421:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789584000.895167:0:16421:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789584000.895169:0:16421:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789584000.895182:0:16421:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8df52e6a00/0x113b6add9f868d2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868d34 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.895205:0:16421:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789584000.895218:0:16421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8df52e6a00/0x113b6add9f868d2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868d34 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.895223:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8df52e6a00/0x113b6add9f868d2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868d34 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.895231:0:16421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789584000.895234:0:16421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e200/0x113b6add9f868ed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868ed8 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.895239:0:16421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5e200 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:1.0:1789584000.895241:0:16421:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e200/0x113b6add9f868ed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868ed8 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.895247:0:16421:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e200/0x113b6add9f868ed1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868ed8 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789584000.895253:0:16421:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e200/0x113b6add9f868ed1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868ed8 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584000.895256:0:16421:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789584000.895258:0:16421:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789584000.895264:0:16421:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789584000.895278:0:16421:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e200/0x113b6add9f868ed1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868ed8 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.895284:0:16421:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1789584000.895435:0:20284:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8dc7da6800): rc 0 00000004:00000080:0.0:1789584000.895441:0:20284:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb71709d57ae0 00000100:00080000:0.0:1789584000.895461:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789584000.895464:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:2.0:1789584000.896014:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc44b8000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789584000.896063:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df623e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789584000.896083:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df623b000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789584000.896107:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8cc44bb800 for lustre-MDT0000 00000020:00000080:2.0:1789584000.896111:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8df623b800 for lustre-MDT0000 00000020:00000080:2.0:1789584000.896114:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8df6239000 for lustre-MDT0000 00000100:00100000:2.0:1789584000.896136:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3455:1876514253814528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789584000.896211:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789584000.896250:0:20284:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789584000.896265:0:16419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253814528 00000100:00080000:0.0:1789584000.896266:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4759800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789584000.896271:0:16419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253814528 00000100:00080000:0.0:1789584000.896390:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789584000.896394:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1789584000.896405:0:20284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789584000.896469:0:20284:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789584000.896478:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8f8dc6e9f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789584000.896485:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789584000.896487:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1789584000.896494:0:20284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1789584000.896500:0:16421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e200/0x113b6add9f868ed1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868ed8 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.896509:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e200/0x113b6add9f868ed1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868ed8 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.896520:0:16421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789584000.896524:0:16421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86890c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868913 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.896530:0:16421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe9200 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:1.0:1789584000.896534:0:16421:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86890c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868913 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.896542:0:16421:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86890c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868913 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789584000.896549:0:16421:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86890c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868913 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584000.896555:0:16421:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000100:00080000:0.0:1789584000.896555:0:20284:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 10000000:01000000:1.0:1789584000.896558:0:16421:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789584000.896559:0:16421:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:0.0:1789584000.896562:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8f8cc5acf800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789584000.896575:0:16421:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86890c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868913 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.896581:0:16421:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1789584000.896586:0:20284:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8f8df72c19c0) has no exports 00010000:00010000:1.0:1789584000.896597:0:16421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86890c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868913 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.896604:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86890c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868913 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.896613:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584000.896615:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584000.896617:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789584000.896630:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3454:1876514253815296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789584000.896660:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584000.896693:0:16417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253815296 00000100:00100000:1.0:1789584000.896697:0:16417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253815296 00000100:00100000:3.0:1789584000.896744:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3456:1876514253814656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789584000.896774:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584000.896806:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789584000.896811:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3456:1876514253814784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789584000.896831:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584000.896864:0:17493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253814656 00000100:00100000:3.0:1789584000.896867:0:17493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253814656 00000100:00100000:1.0:1789584000.896913:0:16417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253814784 00000100:00100000:1.0:1789584000.896917:0:16417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253814784 00000100:00100000:3.0:1789584000.899548:0:17493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789584000.899571:0:17493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfd2e540-776d-4d6d-9d40-7d81c66add0c+26:3454:x1876514253815296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789584000.899587:0:17493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789584000.899606:0:17493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df52e6600/0x113b6add9f868913 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f86890c expref: 26 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584000.899623:0:17493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789584000.899691:0:17493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfd2e540-776d-4d6d-9d40-7d81c66add0c+25:3454:x1876514253815296:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (3029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584000.899698:0:17493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789584000.899716:0:17493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789584000.899722:0:17493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfac29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfd2e540-776d-4d6d-9d40-7d81c66add0c+24:3456:x1876514253814656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789584000.899731:0:17493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789584000.899754:0:17493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df52e7e00/0x113b6add9f868d34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f868d2d expref: 24 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584000.899764:0:17493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789584000.899805:0:17493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfac29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfd2e540-776d-4d6d-9d40-7d81c66add0c+23:3456:x1876514253814656:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584000.899811:0:17493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789584000.899869:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3454:1876514253815296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789584000.899900:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253814912:0@lo:39:umount.0 00000100:00100000:3.0:1789584000.899937:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584000.899965:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253815040:0@lo:9:umount.0 00000100:00100000:3.0:1789584000.899990:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584000.900023:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253815168:0@lo:9:umount.0 00000100:00100000:3.0:1789584000.900047:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584000.900079:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253814912 00000100:00100000:3.0:1789584000.900361:0:16437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253814912 00000100:00100000:3.0:1789584000.900397:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789584000.900403:0:16437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfac2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3453:x1876514253814912:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789584000.900429:0:16437:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868b12 00000100:00080000:3.0:1789584000.900438:0:16437:0:(import.c:65:import_set_state_nolock()) ffff8f8cc44b9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789584000.900461:0:16437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789584000.900634:0:16437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfac2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3453:x1876514253814912:12345-0@lo:39:umount.0 Request processed in 229us (695us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789584000.900641:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789584000.900660:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253815040 00000100:00100000:3.0:1789584000.900664:0:17746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253815040 00000100:00100000:3.0:1789584000.900693:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253815168 00000100:00100000:1.0:1789584000.900697:0:16417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789584000.900703:0:17746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253815168 00000100:00100000:1.0:1789584000.900706:0:16417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfac28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfd2e540-776d-4d6d-9d40-7d81c66add0c+22:3456:x1876514253814784:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789584000.900726:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789584000.900733:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876514253815040:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789584000.900760:0:17746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868c23 00000100:00080000:3.0:1789584000.900766:0:17746:0:(import.c:65:import_set_state_nolock()) ffff8f8cc44ba000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789584000.900802:0:17746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1789584000.901045:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3453:x1876514253815040:12345-0@lo:9:umount.0 Request processed in 311us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584000.901051:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789584000.901063:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789584000.901069:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876514253815168:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789584000.901079:0:17746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868d3b 00000100:00080000:3.0:1789584000.901084:0:17746:0:(import.c:65:import_set_state_nolock()) ffff8f8dc6b02000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789584000.904175:0:16417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789584000.904220:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df4fe8a00/0x113b6add9f868ed8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f868ed1 expref: 22 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584000.904240:0:16417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789584000.904383:0:16417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfac28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfd2e540-776d-4d6d-9d40-7d81c66add0c+21:3456:x1876514253814784:12345-0@lo:103:ldlm_bl.0 Request processed in 3676us (7548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584000.904393:0:16417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000001:00000004:3.0:1789584000.904698:0:17746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789584000.905028:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3453:x1876514253815168:12345-0@lo:9:umount.0 Request processed in 3957us (4978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584000.905036:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1789584000.905071:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789584000.905077:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789584000.906079:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4759800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789584000.906092:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253814912:0@lo:39:umount.0 00000100:00080000:3.0:1789584000.906117:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dc6e9f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789584000.906122:0:3453:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789584000.906124:0:3453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789584000.906126:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253815040:0@lo:9:umount.0 00000100:00080000:3.0:1789584000.906344:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc5acf800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789584000.906362:0:3453:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789584000.906381:0:3453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789584000.906385:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253815168:0@lo:9:umount.0 00000100:00100000:3.0:1789584000.906451:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3456:1876514253814784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789584000.906460:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3456:1876514253814656:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789584000.906490:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584000.906501:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789584000.907587:0:16419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789584000.907605:0:16419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce30450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfd2e540-776d-4d6d-9d40-7d81c66add0c+20:3455:x1876514253814528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789584000.907622:0:16419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789584000.907640:0:16419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8defc5fc00/0x113b6add9f868921 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f86891a expref: 20 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584000.907652:0:16419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789584000.907725:0:16419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce30450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfd2e540-776d-4d6d-9d40-7d81c66add0c+19:3455:x1876514253814528:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (11514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584000.907742:0:16419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789584000.907839:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3455:1876514253814528:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789584000.914500:0:20284:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8f8df72c19c0) has no exports 00000020:00000080:3.0:1789584000.982706:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868967 00000020:00000080:3.0:1789584000.982722:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8df74f0800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789584000.982850:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df74f0800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789584000.982897:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789584000.983073:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789584000.983093:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789584000.983100:0:20284:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8f8def4b19c0) has no exports 00000020:00000080:0.0:1789584000.984078:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868960 00000020:00000080:0.0:1789584000.984097:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8cc5ace800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789584000.985128:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc5ace800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789584000.985712:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584000.985724:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789584000.985729:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8dc935e800/lustre-QMT0000_UUID 00000020:00000080:0.0:1789584000.985732:0:20284:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dc935e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789584000.985741:0:20284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1789584001.052048:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789584002.011902:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789584002.011928:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253815424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789584002.011999:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584002.012100:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253815424 00000100:00100000:0.0:1789584002.012108:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253815424 00000100:00100000:0.0:1789584002.012203:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789584002.012214:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253815424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789584002.012259:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789584002.012313:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253815424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584002.012319:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789584002.015243:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789584002.015655:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253815424:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789584002.093361:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789584002.100248:0:8131:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789584002.100258:0:8131:0:(genops.c:885:class_export_put()) final put ffff8f8cc44bd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789584002.102125:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc44bd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789584002.102237:0:12001:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8cc44ba000 for lustre-OST0000 00000100:00100000:3.0:1789584002.523562:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253815552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789584002.523629:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584002.523725:0:17344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253815552 00000100:00100000:0.0:1789584002.523734:0:17344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253815552 00000100:00100000:0.0:1789584002.523795:0:17344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789584002.523802:0:17344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3456:x1876514253815552:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1789584002.523824:0:17344:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789584002.523870:0:17344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3456:x1876514253815552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (240us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789584002.523877:0:17344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:02020000:2.0:1789584002.524336:0:3456:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1789584002.541460:0:3456:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789584002.541470:0:3456:0:(import.c:65:import_set_state_nolock()) ffff8f8dd8644000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789584002.541475:0:3456:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789584002.565727:0:3456:0:(import.c:65:import_set_state_nolock()) ffff8f8dd8644000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789584002.565741:0:3456:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 568 00000100:00080000:2.0:1789584002.565768:0:3456:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f8dd8644000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1789584002.565813:0:3456:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8df7818000 x1876514253815680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789584002.568162:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253815680:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789584002.568294:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584002.568528:0:16438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253815680 00000100:00100000:0.0:1789584002.568536:0:16438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253815680 00000100:00100000:0.0:1789584002.568578:0:16438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789584002.568586:0:16438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3453:x1876514253815680:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1789584002.568603:0:16438:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789584002.579919:0:16438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3453:x1876514253815680:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 11321us (11614us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789584002.579936:0:16438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789584002.584064:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dd8644000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789584002.584078:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789584002.584083:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253815680:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1789584003.036795:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789584003.036802:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789584003.036807:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8dd8644000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789584003.036823:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 655 00000100:00080000:3.0:1789584003.036841:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789584003.036853:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f8dd8644000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1789584003.036878:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dff9b8e00 x1876514253815936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789584003.036975:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253816192:0@lo:400:kworker.0 00000100:00100000:3.0:1789584003.037046:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584003.037078:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3455:1876514253816704:0@lo:400:kworker.0 00000100:00100000:3.0:1789584003.037104:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584003.037128:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789584003.037134:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253816064:0@lo:400:kworker.0 00000100:00100000:3.0:1789584003.037156:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584003.037173:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3455:1876514253816576:0@lo:400:kworker.0 00000100:00100000:3.0:1789584003.037225:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584003.037428:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253816192 00000100:00100000:3.0:1789584003.037436:0:17746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253816192 00000100:00100000:3.0:1789584003.037483:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253816064 00000100:00100000:3.0:1789584003.037486:0:17746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253816064 00000100:00100000:3.0:1789584003.037502:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789584003.037509:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253816192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584003.037555:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253816192:12345-0@lo:400:kworker.0 Request processed in 46us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584003.037562:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789584003.037576:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789584003.037582:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253816064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584003.037609:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253816064:12345-0@lo:400:kworker.0 Request processed in 27us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584003.037625:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1789584003.037646:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789584003.037683:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253816064:0@lo:400:kworker.0 00000100:00100000:3.0:1789584003.037694:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253816192:0@lo:400:kworker.0 00000100:00100000:3.0:1789584003.037717:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253815936:0@lo:38:kworker.0 00000100:00100000:3.0:1789584003.037744:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584003.037785:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253815936 00000100:00100000:3.0:1789584003.037789:0:16437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253815936 00000100:00100000:3.0:1789584003.037808:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789584003.039963:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253816704 00000100:00100000:2.0:1789584003.039975:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253816704 00000100:00100000:2.0:1789584003.040021:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253816576 00000100:00100000:2.0:1789584003.040025:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253816576 00000100:00100000:2.0:1789584003.040062:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789584003.040072:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876514253816576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584003.040154:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876514253816576:12345-0@lo:400:kworker.0 Request processed in 85us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584003.040161:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789584003.040178:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789584003.040182:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3455:x1876514253816704:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789584003.040226:0:18999:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789584003.040267:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3455:x1876514253816704:12345-0@lo:400:kworker.0 Request processed in 82us (3162us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789584003.040284:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1789584003.040313:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789584003.040446:0:16437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3453:x1876514253815936:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1789584003.040463:0:16437:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789584003.040506:0:16437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3453:x1876514253815936:12345-0@lo:38:kworker.0 Request processed in 61us (2762us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789584003.040573:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3457:1876514253815808:0@lo:400:kworker.0 00000100:00100000:0.0:1789584003.040621:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584003.040661:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3457:1876514253816448:0@lo:400:kworker.0 00000100:00100000:0.0:1789584003.040687:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584003.040708:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253816960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789584003.040732:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584003.040769:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789584003.040776:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3457:1876514253816320:0@lo:400:kworker.0 00000100:00100000:0.0:1789584003.040799:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584003.040830:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3457:1876514253816832:0@lo:400:kworker.0 00000100:00100000:0.0:1789584003.040852:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584003.040878:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253815808 00000100:00100000:0.0:1789584003.040883:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253815808 00000100:00100000:0.0:1789584003.040913:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789584003.040927:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df5173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfd2e540-776d-4d6d-9d40-7d81c66add0c+19:3457:x1876514253815808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584003.040967:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df5173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfd2e540-776d-4d6d-9d40-7d81c66add0c+19:3457:x1876514253815808:12345-0@lo:400:kworker.0 Request processed in 40us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584003.040973:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789584003.041004:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253816960 00000100:00100000:0.0:1789584003.041007:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253816960 00000100:00100000:0.0:1789584003.041031:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789584003.041037:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253816960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789584003.041066:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789584003.041100:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253816960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584003.041106:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789584003.041138:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3457:1876514253815808:0@lo:400:kworker.0 00000100:00100000:0.0:1789584003.041157:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253816960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789584003.042238:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253816448 00000100:00100000:0.0:1789584003.043142:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253816320 00000100:00100000:0.0:1789584003.043151:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253816320 00000100:00100000:0.0:1789584003.043214:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253816832 00000100:00100000:0.0:1789584003.043217:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253816832 00000100:00100000:0.0:1789584003.043273:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789584003.043284:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3457:x1876514253816832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584003.043376:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3457:x1876514253816832:12345-0@lo:400:kworker.0 Request processed in 95us (2522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584003.043382:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789584003.043398:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789584003.043402:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3457:x1876514253816320:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789584003.043407:0:16434:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789584003.043448:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3457:x1876514253816320:12345-0@lo:400:kworker.0 Request processed in 44us (2648us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789584003.043455:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1789584003.043499:0:3457:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789584003.043505:0:3457:0:(import.c:65:import_set_state_nolock()) ffff8f8df623f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789584003.043508:0:3457:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789584003.043513:0:3457:0:(import.c:65:import_set_state_nolock()) ffff8f8df623f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789584003.043518:0:3457:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 568 00000100:00080000:0.0:1789584003.043526:0:3457:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f8df623f000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1789584003.043555:0:3457:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1af480 x1876514253817088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789584003.043573:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3457:1876514253816320:0@lo:400:kworker.0 00010000:00080000:0.0:1789584003.043588:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dc4c5d880 x1876514253816832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584003.043599:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3457:1876514253816832:0@lo:400:kworker.0 00010000:00080000:0.0:1789584003.043649:0:3455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dff9bb100 x1876514253816576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584003.043658:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3455:1876514253816576:0@lo:400:kworker.0 00000100:00080000:0.0:1789584003.043669:0:3455:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789584003.043672:0:3455:0:(import.c:65:import_set_state_nolock()) ffff8f8df6238000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789584003.043675:0:3455:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789584003.043678:0:3455:0:(import.c:65:import_set_state_nolock()) ffff8f8df6238000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789584003.043681:0:3455:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 600 00000100:00080000:0.0:1789584003.043694:0:3455:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f8df6238000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1789584003.043707:0:3455:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1ac380 x1876514253817216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789584003.043717:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3455:1876514253816704:0@lo:400:kworker.0 00000100:00080000:0.0:1789584003.043789:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789584003.043853:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876514253817088:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1789584003.043887:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584003.043909:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3453:1876514253817216:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789584003.043929:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789584003.043952:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dd8644000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584003.043957:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789584003.043960:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253815936:0@lo:38:kworker.0 00000100:00100000:0.0:1789584003.043983:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253817088 00000100:00100000:0.0:1789584003.043986:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253817088 00000100:00100000:0.0:1789584003.044003:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253817216 00000100:00100000:0.0:1789584003.044005:0:18999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253817216 00000100:00100000:0.0:1789584003.044014:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789584003.044019:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3453:x1876514253817088:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1789584003.044033:0:18999:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789584003.044068:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3453:x1876514253817088:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 47us (180us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789584003.044073:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789584003.044084:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789584003.044087:0:18999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3453:x1876514253817216:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1789584003.044094:0:18999:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789584003.044115:0:18999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3453:x1876514253817216:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 26us (185us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789584003.044127:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1789584003.044154:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8df623f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584003.044157:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789584003.044161:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876514253817088:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1789584003.044168:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8df6238000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584003.044170:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789584003.044173:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3453:1876514253817216:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789584003.045850:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253816448 00000100:00100000:1.0:1789584003.045898:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789584003.045914:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1876514253816448:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789584003.045922:0:16432:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789584003.045980:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1876514253816448:12345-0@lo:400:kworker.0 Request processed in 74us (5292us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789584003.045987:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789584003.047089:0:3457:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789584003.047095:0:3457:0:(import.c:65:import_set_state_nolock()) ffff8f8dc3e7f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789584003.047099:0:3457:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789584003.047104:0:3457:0:(import.c:65:import_set_state_nolock()) ffff8f8dc3e7f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789584003.047108:0:3457:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 583 00000100:00080000:0.0:1789584003.047119:0:3457:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f8dc3e7f800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1789584003.047147:0:3457:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1ac380 x1876514253817344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789584003.047169:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3457:1876514253816448:0@lo:400:kworker.0 00000100:00100000:0.0:1789584003.047220:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3453:1876514253817344:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1789584003.047741:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584003.049387:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253817344 00000100:00100000:1.0:1789584003.049398:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253817344 00000100:00100000:1.0:1789584003.049434:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789584003.049443:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3453:x1876514253817344:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789584003.049462:0:16433:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789584003.049517:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3453:x1876514253817344:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 74us (1777us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789584003.049523:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1789584003.050988:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dc3e7f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584003.050998:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789584003.051002:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3453:1876514253817344:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1789584003.064450:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1789584003.104349:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789584003.110060:0:7262:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 74c62c8b-20fd-4180-b5fa-7ba19c1807c1 00000001:00080000:2.0:1789584003.110076:0:7262:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1789584003.110081:0:7262:0:(genops.c:885:class_export_put()) final put ffff8f8e01e75000/74c62c8b-20fd-4180-b5fa-7ba19c1807c1 00000001:00100000:2.0:1789584003.110107:0:7262:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789584003.110114:0:7262:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1789584003.110116:0:7262:0:(genops.c:885:class_export_put()) final put ffff8f8def4ba800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789584003.110431:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8e01e75000/74c62c8b-20fd-4180-b5fa-7ba19c1807c1 for lustre-MDT0001 00000020:00000080:0.0:1789584003.110510:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8def4ba800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1789584003.110531:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8e01e76000 for lustre-MDT0001 00000020:00000080:0.0:1789584003.110536:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8cc44b9000 for lustre-MDT0001 00000001:00100000:3.0:1789584003.614547:0:9074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789584003.614556:0:9074:0:(genops.c:885:class_export_put()) final put ffff8f8dc6b02800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789584003.614622:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dc6b02800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789584003.614673:0:12001:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8dc6b02000 for lustre-OST0001 00010000:00010000:3.0:1789584004.123637:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584005.149043:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789584005.681918:0:6470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789584005.681928:0:6470:0:(genops.c:885:class_export_put()) final put ffff8f8dc7da6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789584005.682060:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dc7da6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789584005.683305:0:12001:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8dc7da5000 for lustre-MDT0000 00010000:00010000:3.0:1789584006.172695:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789584007.067381:0:20284:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f8dc6bbfc60 - data ffff8f8dfc16a0d8/ffff8f8cc4528c00 00000020:01000000:2.0:1789584007.067541:0:20284:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f8df6221e40 - data ffff8f8dde84c1b0/ffff8f8e01ce4400 00000001:00000004:2.0:1789584007.085562:0:20284:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00100000:0.0:1789584007.132512:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253817472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789584007.132583:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584007.132659:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253817472 00000100:00100000:0.0:1789584007.132679:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253817472 00000100:00100000:0.0:1789584007.132743:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789584007.132753:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253817472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789584007.132789:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789584007.132835:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253817472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584007.132841:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1789584007.132862:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789584007.132898:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253817472:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789584007.197471:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789584007.200176:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789584007.200185:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789584007.200224:0:20284:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8f8dee1adc00 x1876514253814912/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789584010 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584007.200284:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789584007.215767:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789584007.215776:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1789584007.215801:0:20284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789584007.215804:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789584007.217785:0:16456:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789584007.217793:0:16456:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1789584007.217804:0:16456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1789584007.218870:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789584007.218877:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1789584007.218897:0:20284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789584007.218900:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789584007.219257:0:16458:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789584007.219261:0:16458:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1789584007.219272:0:16458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1789584007.298244:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f86892f 00000020:00000080:3.0:1789584007.298259:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8df74eb800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789584007.299109:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df74eb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789584007.299528:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868944 00000020:00000080:3.0:1789584007.299534:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8df74ed000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789584007.299548:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789584007.299556:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584007.299564:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789584007.299568:0:20284:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8f8df72c3380) has no exports 00000004:01000000:3.0:1789584007.299734:0:20284:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789584007.299742:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f8689a6 00000020:00000080:3.0:1789584007.299746:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8dc2f99000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789584007.299750:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789584007.299753:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584007.299757:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789584007.299760:0:20284:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8f8e009bcd40) has no exports 00000020:00000080:3.0:1789584007.299766:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f86899f 00000020:00000080:3.0:1789584007.299768:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8cc5acf000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789584007.300074:0:20284:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789584007.300079:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789584007.300083:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1789584007.300089:0:20284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789584007.300091:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789584007.300250:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df74ed000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1789584007.300257:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dc2f99000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789584007.300261:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc5acf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789584007.300266:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8cc5acf800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789584007.300314:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789584007.300321:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789584007.300324:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8dc2f9a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789584007.300326:0:20284:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dc2f9a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789584007.300330:0:20284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789584007.300394:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868991 00000020:00000080:3.0:1789584007.300398:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8df74f2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789584007.300438:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789584007.300442:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584007.300446:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789584007.300448:0:20284:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8f8e009b8000) has no exports 00000020:00000080:3.0:1789584007.300452:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f86898a 00000020:00000080:3.0:1789584007.300455:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8dc6e9c800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789584007.302738:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df74f2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1789584007.307004:0:20284:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789584007.307014:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789584007.307017:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1789584007.307026:0:20284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789584007.307028:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789584007.307373:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dc6e9c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789584007.307488:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789584007.307498:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1789584007.307514:0:20284:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789584007.307523:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f86897c 00000020:00000080:3.0:1789584007.307533:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8cc475c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789584007.307556:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8dc6e9f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789584007.307563:0:8:0:(genops.c:885:class_export_put()) final put ffff8f8cc475a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789584007.307565:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc475a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789584007.307571:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789584007.307708:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789584007.307714:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584007.307719:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789584007.307723:0:20284:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff8f8def4b0000) has no exports 00000020:00000080:3.0:1789584007.307730:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868975 00000020:00000080:3.0:1789584007.307739:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8cc475e800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789584007.307758:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc475c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00010000:01000000:3.0:1789584007.308841:0:20284:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1789584007.308847:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789584007.308861:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789584007.308867:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789584007.308928:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc475e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789584007.309121:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789584007.309136:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789584007.309158:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789584007.309160:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789584007.309164:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8df74ec000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789584007.309166:0:20284:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df74ec000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789584007.309171:0:20284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789584007.309261:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f86894b 00000020:00000080:3.0:1789584007.309267:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8df74ee000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789584007.309369:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8cc4759800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789584007.309375:0:8:0:(genops.c:885:class_export_put()) final put ffff8f8cc475e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789584007.309377:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc475e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789584007.309381:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789584007.309463:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789584007.309468:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584007.309472:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789584007.309475:0:20284:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8f8e009b99c0) has no exports 00000020:00000080:3.0:1789584007.309496:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789584007.309499:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789584007.309503:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868952 00000020:00000080:3.0:1789584007.309506:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8df74e8800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789584007.309527:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df74ee000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789584007.309530:0:8:0:(genops.c:885:class_export_put()) final put ffff8f8df74ef800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789584007.309532:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df74ef800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789584007.309536:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1789584007.309608:0:20284:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8dc936c800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789584007.309612:0:20284:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8dc936c800 3 00000020:01000004:3.0:1789584007.309615:0:20284:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f8dc936c800 from lustre-MDT0000 00000020:00000080:3.0:1789584007.309636:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789584007.309639:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789584007.309642:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8df74ef000/lustre-MDT0000_UUID 00000020:00000080:3.0:1789584007.309644:0:20284:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df74ef000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789584007.309650:0:20284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789584007.309690:0:20284:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1789584007.309694:0:20284:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789584007.309697:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789584007.309700:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584007.309702:0:20284:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789584007.309715:0:20284:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8f8dfce00000 bfd2e540-776d-4d6d-9d40-7d81c66add0c 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789584007.309721:0:20284:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8f8def4b4d40) has exports, disconnecting them 00000020:00080000:3.0:1789584007.309725:0:20284:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8f8dfce00000), last request at 1789583901 00000020:00000080:3.0:1789584007.309739:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f8688f7 00000020:00010000:3.0:1789584007.309743:0:20284:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8f8dfce00000: total 1 00000100:00080000:3.0:1789584007.309747:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8f8de79cc000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789584007.309767:0:20284:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8dfce00000): rc 0 00000020:00080000:3.0:1789584007.309770:0:20284:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8f8def4b4d40) has no exports 00000020:00010000:0.0:1789584007.309874:0:16421:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8f8dfce00000: total 1 00010000:00010000:0.0:1789584007.309878:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584007.309918:0:16421:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f8dfce00000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789584007.309954:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df52e7c00/0x113b6add9f868c1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f868c15 expref: 14 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584007.309970:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df4fe8e00/0x113b6add9f868eca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f868ec3 expref: 13 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584007.309981:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8defc5e800/0x113b6add9f868b58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f868b51 expref: 12 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584007.309999:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8dee6f4600/0x113b6add9f868d26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f868d1f expref: 11 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584007.310012:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df52e6800/0x113b6add9f868a16 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f868a0f expref: 10 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584007.310024:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df52e7200/0x113b6add9f868b82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f868b7b expref: 9 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584007.310033:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8dee6f4a00/0x113b6add9f868eae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f868ea7 expref: 8 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584007.310042:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8dee6f4200/0x113b6add9f868ad3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f868acc expref: 7 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584007.310052:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8defc5ec00/0x113b6add9f868a24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f868a1d expref: 6 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584007.310062:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df4fe9a00/0x113b6add9f868ebc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f868eb5 expref: 5 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584007.310072:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8defc5ee00/0x113b6add9f868a32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f868a2b expref: 4 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584007.310081:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df52e7000/0x113b6add9f868905 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f8688fe expref: 3 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584007.310091:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8defc5f800/0x113b6add9f868bf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x113b6add9f868beb expref: 2 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584007.310109:0:16421:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f8dfce00000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1789584007.310121:0:16421:0:(genops.c:885:class_export_put()) final put ffff8f8dfce00000/bfd2e540-776d-4d6d-9d40-7d81c66add0c 00000020:00000080:1.0:1789584007.310418:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df74e8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789584007.310484:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584007.310486:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584007.310488:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584007.310516:0:16424:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8f8cc68d7a00:16424] 0 exiting: rc = 1 00000020:00000080:1.0:1789584007.310601:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dfce00000/bfd2e540-776d-4d6d-9d40-7d81c66add0c for MGS 00000020:00000080:1.0:1789584007.310707:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8de79cc000 for MGS 00000100:00100000:0.0:1789584007.321293:0:16425:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8f8df50edc00:16425] 1 exiting: rc = 0 00000100:00100000:0.0:1789584007.321393:0:16426:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8f8cc44a7600:16426] 2 exiting: rc = 0 00000100:00100000:1.0:1789584007.323425:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323435:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323440:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323446:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323451:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323457:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323463:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323469:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323475:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323481:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323487:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323506:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323513:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323518:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323525:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323530:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323535:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323541:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323547:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323552:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323558:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323563:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323568:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323574:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323580:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323585:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323591:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323597:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323602:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323607:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323614:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323619:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323624:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323630:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323636:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323642:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323647:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323653:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323659:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323679:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323685:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323691:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323696:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323702:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323707:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323712:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323725:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323730:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323735:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323741:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323746:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323751:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323756:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323761:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323766:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323772:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.323777:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.324053:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.324068:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.324074:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.324080:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.324086:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.324092:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584007.324097:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1789584007.327630:0:20284:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789584007.327637:0:20284:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1789584007.328485:0:20284:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f8dc6bbff60 - data ffff8f8dde8a0798/ffff8f8df4e87000 00000020:01000000:0.0:1789584007.328579:0:20284:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f8dc7d43900 - data ffff8f8df8bc06c0/ffff8f8cc44b4800 00000020:00000080:0.0:1789584007.329037:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f8688db 00000020:00000080:0.0:1789584007.329045:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8dfce05000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789584007.329067:0:20284:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8dc936c800 from MGS, refs=2 00000020:01000004:0.0:1789584007.329070:0:20284:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8dc936c800 2 00000020:01000004:0.0:1789584007.329073:0:20284:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f8dc936c800 from MGS 00000020:00000080:0.0:1789584007.329096:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584007.329102:0:20284:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789584007.329104:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8dfce01000/MGS 00000020:00000080:0.0:1789584007.329107:0:20284:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dfce01000/MGS for MGS 00000020:01000000:0.0:1789584007.329113:0:20284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1789584007.329220:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dfce05000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789584007.329303:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789584007.329307:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789584007.329312:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789584007.329320:0:20284:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8f8dcb7ea000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789584007.329326:0:20284:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8f8cc477b380) has exports, disconnecting them 00000020:00080000:0.0:1789584007.329331:0:20284:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8f8dcb7ea000), last request at 1789583902 00000020:00000080:0.0:1789584007.329335:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f8689de 00000020:00080000:0.0:1789584007.329349:0:20284:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8dcb7ea000): rc 0 00000020:00000080:0.0:1789584007.329353:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8dcb7ea000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789584007.329975:0:20284:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789584007.329981:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789584007.329985:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789584007.329989:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789584007.331152:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dcb7ea000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789584007.331434:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584007.331441:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789584007.331447:0:20284:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8dc936c800 1 00000020:00000080:0.0:1789584007.331451:0:20284:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f8688cd 00000020:00000080:0.0:1789584007.331457:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8dfce06000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789584007.331462:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789584007.331466:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789584007.331468:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789584007.331471:0:20284:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8f8df768b380) has no exports 00000020:00000080:1.0:1789584007.331572:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8dee198000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789584007.331579:0:8:0:(genops.c:885:class_export_put()) final put ffff8f8dfc7da800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789584007.331581:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dfc7da800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789584007.331585:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789584007.331643:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dfce06000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789584007.389310:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789584007.389324:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789584007.389330:0:20284:0:(genops.c:885:class_export_put()) final put ffff8f8dc936d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789584007.389335:0:20284:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dc936d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789584007.389346:0:20284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789584007.389477:0:20284:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f8dc936a800 00000020:02000400:1.0:1789584007.389539:0:20284:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000040:00080000:0.0:1789584007.582423:0:17089:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789584008.159296:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789584008.159320:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253817600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789584008.159389:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584008.159466:0:17748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253817600 00000100:00100000:2.0:1789584008.159475:0:17748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253817600 00000100:00100000:2.0:1789584008.159543:0:17748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789584008.159555:0:17748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253817600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789584008.159589:0:17748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789584008.159634:0:17748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253817600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584008.159641:0:17748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789584008.159692:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789584008.159729:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253817600:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789584008.160150:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789584008.160156:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789584008.160160:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8dd8644000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789584008.160165:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 656 00000100:00080000:1.0:1789584008.160169:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789584008.160181:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f8dd8644000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584008.160230:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1ab480 x1876514253817856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789584008.160257:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789584008.160260:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789584008.160262:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8df623f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789584008.160265:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 656 00000100:00080000:1.0:1789584008.160268:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789584008.160272:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f8df623f000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584008.160283:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1aa300 x1876514253818112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789584008.160293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789584008.160296:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789584008.160297:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8dc3e7f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789584008.160301:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 656 00000100:00080000:1.0:1789584008.160303:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789584008.160308:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f8dc3e7f800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584008.160318:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1aa680 x1876514253818240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789584008.160338:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789584008.160348:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789584008.160350:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8df6238000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789584008.160355:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 656 00000100:00080000:1.0:1789584008.160357:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789584008.160362:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f8df6238000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584008.160373:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1a9c00 x1876514253818496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789584008.160401:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253817856:0@lo:38:kworker.0 00000100:00100000:1.0:1789584008.160434:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584008.160454:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876514253818112:0@lo:38:kworker.0 00000100:00100000:1.0:1789584008.160474:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584008.160487:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3453:1876514253818240:0@lo:38:kworker.0 00000100:00100000:1.0:1789584008.160504:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584008.160517:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3453:1876514253818496:0@lo:38:kworker.0 00000100:00100000:1.0:1789584008.160533:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584008.160558:0:16438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253817856 00000100:00100000:1.0:1789584008.160563:0:16438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253817856 00000100:00100000:1.0:1789584008.160583:0:16438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789584008.160588:0:16438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3453:x1876514253817856:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789584008.160607:0:16438:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789584008.165393:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3456:1876514253817728:0@lo:400:kworker.0 00000400:00000100:0.0:1789584008.165456:0:3456:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876514253817728 offset 0 length 224: 4 00000100:00100000:0.0:1789584008.165508:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789584008.165515:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253817984:0@lo:400:kworker.0 00000100:00100000:0.0:1789584008.165549:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584008.165618:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253818112 00000100:00100000:0.0:1789584008.165627:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253818112 00000100:00100000:0.0:1789584008.165680:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253818240 00000100:00100000:0.0:1789584008.165684:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253818240 00000100:00100000:0.0:1789584008.165698:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253818496 00000100:00100000:0.0:1789584008.165700:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253818496 00000100:00100000:0.0:1789584008.165712:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789584008.165719:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3453:x1876514253818112:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789584008.165742:0:18945:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789584008.165804:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3453:x1876514253818112:12345-0@lo:38:kworker.0 Request processed in 84us (5327us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789584008.165811:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789584008.165826:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789584008.165830:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3453:x1876514253818240:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789584008.165840:0:18945:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789584008.165862:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3453:x1876514253818240:12345-0@lo:38:kworker.0 Request processed in 31us (5357us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789584008.165868:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789584008.165878:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789584008.165882:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3453:x1876514253818496:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789584008.165891:0:18945:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789584008.165914:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3453:x1876514253818496:12345-0@lo:38:kworker.0 Request processed in 31us (5379us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789584008.165919:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789584008.165942:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3455:1876514253818624:0@lo:400:kworker.0 00000100:00100000:0.0:1789584008.165968:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584008.165986:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789584008.165992:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3455:1876514253818368:0@lo:400:kworker.0 00000100:00100000:0.0:1789584008.166010:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584008.166030:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253818624 00000100:00100000:0.0:1789584008.166033:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253818624 00000100:00100000:0.0:1789584008.166065:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253818368 00000100:00100000:0.0:1789584008.166068:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253818368 00000100:00100000:0.0:1789584008.166083:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789584008.166089:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876514253818624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584008.166135:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876514253818624:12345-0@lo:400:kworker.0 Request processed in 47us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584008.166142:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789584008.166154:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789584008.166160:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876514253818368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584008.166228:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876514253818368:12345-0@lo:400:kworker.0 Request processed in 68us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584008.166234:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:0.0:1789584008.166267:0:3455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8dee1ab100 x1876514253818368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584008.166281:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3455:1876514253818368:0@lo:400:kworker.0 00010000:00080000:0.0:1789584008.166292:0:3455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8dee1aaa00 x1876514253818624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584008.166300:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3455:1876514253818624:0@lo:400:kworker.0 00000100:00080000:2.0:1789584008.167297:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789584008.168066:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8df623f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584008.168076:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789584008.168081:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876514253818112:0@lo:38:kworker.0 00000100:00080000:0.0:1789584008.168095:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dc3e7f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584008.168099:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789584008.168101:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3453:1876514253818240:0@lo:38:kworker.0 00000100:00080000:0.0:1789584008.168111:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8df6238000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584008.168114:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789584008.168117:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3453:1876514253818496:0@lo:38:kworker.0 00000100:00100000:3.0:1789584008.170749:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253817984 00000100:00100000:3.0:1789584008.170765:0:17746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253817984 00000100:00100000:3.0:1789584008.170827:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789584008.170836:0:17746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253817984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584008.170929:0:17746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253817984:12345-0@lo:400:kworker.0 Request processed in 94us (5380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584008.170935:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789584008.170983:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253817984:0@lo:400:kworker.0 00010000:00010000:3.0:1789584008.220130:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789584008.239331:0:16438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3453:x1876514253817856:12345-0@lo:38:kworker.0 Request processed in 78734us (78889us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789584008.239346:0:16438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1789584008.245907:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dd8644000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584008.245922:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789584008.245927:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253817856:0@lo:38:kworker.0 00010000:00010000:0.0:1789584009.243539:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584010.281913:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789584010.642657:0:20440:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789584010.653233:0:20440:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789584010.653286:0:20440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8200/0x113b6add9f868acc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f868ad3 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.653302:0:20440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8200/0x113b6add9f868acc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f868ad3 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.653309:0:20440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8200/0x113b6add9f868acc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868ad3 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.653317:0:20440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8200/0x113b6add9f868acc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868ad3 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.653414:0:20440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789584010.653422:0:20440:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789584010.653455:0:20440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789584010.653460:0:20440:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789584010.653468:0:20440:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789584010.653473:0:20440:0:(import.c:65:import_set_state_nolock()) ffff8f8df623f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789584010.653479:0:20440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789584010.653480:0:20440:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789584010.653483:0:20440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789584010.655020:0:20440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4000/0x113b6add9f868a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f868a32 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.655037:0:20440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4000/0x113b6add9f868a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f868a32 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.655045:0:20440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4000/0x113b6add9f868a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868a32 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.655052:0:20440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4000/0x113b6add9f868a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868a32 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.655700:0:16421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789584010.655710:0:16421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8200/0x113b6add9f868acc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868ad3 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.655718:0:16421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8200 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:0.0:1789584010.655722:0:16421:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8200/0x113b6add9f868acc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868ad3 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.655799:0:16421:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8200/0x113b6add9f868acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868ad3 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789584010.655807:0:16421:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8200/0x113b6add9f868acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868ad3 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789584010.655813:0:16421:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789584010.655815:0:16421:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789584010.655817:0:16421:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789584010.655855:0:16421:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8200/0x113b6add9f868acc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868ad3 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.655863:0:16421:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789584010.655958:0:16421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8200/0x113b6add9f868acc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868ad3 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.655967:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8200/0x113b6add9f868acc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868ad3 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.656002:0:16421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584010.656005:0:16421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4000/0x113b6add9f868a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868a32 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.656011:0:16421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dee6f4000 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:0.0:1789584010.656014:0:16421:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4000/0x113b6add9f868a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868a32 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.656022:0:16421:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4000/0x113b6add9f868a2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868a32 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789584010.656029:0:16421:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4000/0x113b6add9f868a2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868a32 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789584010.656035:0:16421:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789584010.656037:0:16421:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1789584010.656049:0:16421:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4000/0x113b6add9f868a2b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868a32 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.656056:0:16421:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789584010.656063:0:16421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4000/0x113b6add9f868a2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868a32 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.656070:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584010.656072:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584010.656074:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789584010.656182:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3456:1876514253818752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789584010.656281:0:20440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:1.0:1789584010.656282:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789584010.656288:0:20440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4000/0x113b6add9f868a2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868a32 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.656309:0:20440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9000/0x113b6add9f868d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f868d26 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.656326:0:20440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9000/0x113b6add9f868d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f868d26 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.656333:0:20440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9000/0x113b6add9f868d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868d26 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.656341:0:20440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9000/0x113b6add9f868d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868d26 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584010.656356:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3457:1876514253818880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789584010.656373:0:16418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253818752 00000100:00100000:1.0:1789584010.656382:0:16418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253818752 00000100:00100000:2.0:1789584010.656426:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789584010.657083:0:16420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584010.657092:0:16420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9000/0x113b6add9f868d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868d26 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.657115:0:16420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe9000 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:0.0:1789584010.657119:0:16420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9000/0x113b6add9f868d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868d26 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.657128:0:16420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9000/0x113b6add9f868d1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868d26 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789584010.657135:0:16420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9000/0x113b6add9f868d1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868d26 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789584010.657140:0:16420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789584010.657143:0:16420:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1789584010.657165:0:16420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9000/0x113b6add9f868d1f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868d26 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.657171:0:16420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789584010.657212:0:16420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9000/0x113b6add9f868d1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868d26 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.657222:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584010.657224:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584010.657225:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584010.657234:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789584010.657248:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3455:1876514253819008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789584010.657303:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789584010.657725:0:20440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789584010.658086:0:20440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9000/0x113b6add9f868d1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868d26 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789584010.658108:0:20440:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789584010.658119:0:20440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e600/0x113b6add9f868ec3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f868eca expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.658127:0:20440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e600/0x113b6add9f868ec3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f868eca expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.658133:0:20440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e600/0x113b6add9f868ec3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868eca expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.658141:0:20440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e600/0x113b6add9f868ec3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868eca expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.658157:0:20440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789584010.658163:0:20440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4e00/0x113b6add9f868a1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f868a24 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.658180:0:20440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4e00/0x113b6add9f868a1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f868a24 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.658205:0:20440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4e00/0x113b6add9f868a1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868a24 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.658214:0:20440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4e00/0x113b6add9f868a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868a24 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584010.658223:0:20440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789584010.658226:0:20440:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1789584010.658229:0:20440:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789584010.658269:0:20440:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789584010.658273:0:20440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789584010.658280:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584010.658286:0:20440:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789584010.658293:0:20440:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8f8df6239800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789584010.658299:0:20440:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8f8cc576d800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789584010.658304:0:20440:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8f8e009d19c0) has exports, disconnecting them 00000020:00080000:3.0:1789584010.658309:0:20440:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8f8df6239800), last request at 1789584008 00000020:00000080:3.0:1789584010.658315:0:20440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868ccb 00000100:00080000:3.0:1789584010.658333:0:20440:0:(import.c:65:import_set_state_nolock()) ffff8f8de05dc000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789584010.658377:0:20440:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8df6239800): rc 0 00000020:00000080:3.0:1789584010.658380:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8df6239800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789584010.658391:0:20440:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8f8cc576d800), last request at 1789584008 00000020:00000080:3.0:1789584010.658395:0:20440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868bac 00000100:00080000:3.0:1789584010.658400:0:20440:0:(import.c:65:import_set_state_nolock()) ffff8f8cc5768800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789584010.658413:0:20440:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8cc576d800): rc 0 00000020:00000080:3.0:1789584010.658415:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8cc576d800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789584010.658423:0:20440:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb71701473ae0 00000100:00080000:3.0:1789584010.658440:0:20440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789584010.658448:0:20440:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8f8dee1ac700 x1876514253815552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789584018 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584010.658467:0:20440:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789584010.660357:0:20440:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789584010.660367:0:20440:0:(import.c:65:import_set_state_nolock()) ffff8f8dd8644000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:1.0:1789584010.661236:0:16418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253818880 00000100:00100000:1.0:1789584010.661251:0:16418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253818880 00000100:00100000:2.0:1789584010.661292:0:16419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789584010.661311:0:16419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3456:x1876514253818752:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789584010.661322:0:16419:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789584010 with bad export cookie 1241703622367414519 00000020:00000080:0.0:1789584010.661469:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df6239800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1789584010.661541:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc576d800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789584010.661571:0:12001:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8de05dc000 for lustre-MDT0001 00000020:00000080:0.0:1789584010.661596:0:12001:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8cc5768800 for lustre-MDT0001 00010000:00010000:0.0:1789584010.661621:0:16420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789584010.661631:0:16420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e600/0x113b6add9f868ec3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868eca expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.661642:0:16420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5e600 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:0.0:1789584010.661646:0:16420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e600/0x113b6add9f868ec3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868eca expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.661657:0:16420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e600/0x113b6add9f868ec3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868eca expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789584010.661664:0:16420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e600/0x113b6add9f868ec3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868eca expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789584010.661671:0:16420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789584010.661673:0:16420:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789584010.661677:0:16420:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789584010.661723:0:16420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e600/0x113b6add9f868ec3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868eca expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584010.661842:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253815552:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789584010.661940:0:16420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789584010.661962:0:16420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e600/0x113b6add9f868ec3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868eca expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.661969:0:16420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e600/0x113b6add9f868ec3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868eca expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.661980:0:16420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584010.661984:0:16420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4e00/0x113b6add9f868a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868a24 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.662000:0:16420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dee6f4e00 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:0.0:1789584010.662003:0:16420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4e00/0x113b6add9f868a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868a24 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.662010:0:16420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4e00/0x113b6add9f868a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868a24 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789584010.662017:0:16420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4e00/0x113b6add9f868a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868a24 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789584010.662023:0:16420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789584010.662025:0:16420:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789584010.662028:0:16420:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789584010.662042:0:16420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4e00/0x113b6add9f868a1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868a24 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.662048:0:16420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789584010.662067:0:16420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4e00/0x113b6add9f868a1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868a24 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.662074:0:16420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f4e00/0x113b6add9f868a1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x113b6add9f868a24 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584010.662088:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584010.662090:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584010.662092:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584010.662098:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584010.662111:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3455:1876514253819136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789584010.662168:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584010.662403:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3456:1876514253819264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789584010.662433:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584010.663469:0:17493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253819008 00000100:00100000:3.0:1789584010.663479:0:17493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253819008 00000100:00100000:3.0:1789584010.663507:0:17493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253819136 00000100:00100000:3.0:1789584010.663510:0:17493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253819136 00000100:00100000:3.0:1789584010.663525:0:17493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789584010.663534:0:17493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3457:x1876514253818880:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789584010.663541:0:17493:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789584010 with bad export cookie 1241703622367414519 00000100:00100000:3.0:1789584010.663612:0:17493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3457:x1876514253818880:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (7173us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789584010.663620:0:17493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789584010.663640:0:17493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789584010.663644:0:17493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3455:x1876514253819008:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789584010.663648:0:17493:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789584010 with bad export cookie 1241703622367414519 00000100:00100000:3.0:1789584010.663798:0:17493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3455:x1876514253819008:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (6494us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789584010.663805:0:17493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789584010.663824:0:17493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789584010.663828:0:17493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3455:x1876514253819136:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789584010.663846:0:17493:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789584010 with bad export cookie 1241703622367414519 00000100:00100000:3.0:1789584010.663969:0:17493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3455:x1876514253819136:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (1705us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789584010.663978:0:17493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789584010.664054:0:20440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789584010.664060:0:20440:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789584010.664080:0:20440:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789584010.664141:0:20440:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789584010.664159:0:20440:0:(import.c:65:import_set_state_nolock()) ffff8f8dc93a4000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789584010.664175:0:20440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789584010.664177:0:20440:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789584010.665129:0:20440:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789584010.665213:0:20440:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789584010.665232:0:20440:0:(import.c:65:import_set_state_nolock()) ffff8f8dc6b01800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789584010.665266:0:20440:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8f8e009d19c0) has no exports 00000100:00080000:0.0:1789584010.665368:0:3455:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789584010.665373:0:3455:0:(import.c:65:import_set_state_nolock()) ffff8f8dfc7db800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789584010.665377:0:3455:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1789584010.667912:0:17493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253819264 00000100:00100000:1.0:1789584010.667924:0:17493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253819264 00000100:00100000:1.0:1789584010.667968:0:17493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789584010.667977:0:17493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3456:x1876514253819264:12345-0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789584010.669451:0:3457:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00020000:1.0:1789584010.672966:0:17493:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789584010 with bad export cookie 1241703622367414519 00000100:00100000:1.0:1789584010.674563:0:17493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3456:x1876514253819264:12345-0@lo:103:ldlm_bl.0 Request processed in 6568us (12110us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789584010.674579:0:17493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789584010.679719:0:3456:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789584010.690990:0:3455:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.111@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789584010.690998:0:3455:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789584010.691013:0:3455:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8dee1a8700 x1876514253817728/t0(0) o400->MGC192.168.204.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789584024 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584010.691034:0:3455:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8dee1adc00 x1876514253818752/t0(0) o103->MGC192.168.204.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789584026 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584010.691044:0:3455:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8dee1ad180 x1876514253818880/t0(0) o103->MGC192.168.204.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789584026 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584010.691056:0:3455:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8dee1ace00 x1876514253819008/t0(0) o103->MGC192.168.204.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789584026 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584010.691139:0:3455:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8dee1af100 x1876514253819136/t0(0) o103->MGC192.168.204.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789584026 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584010.691150:0:3455:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8dee1ac700 x1876514253819264/t0(0) o103->MGC192.168.204.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789584026 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789584010.691174:0:3455:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789584010.691177:0:3455:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789584010.691179:0:3455:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789584010.691223:0:3455:0:(import.c:65:import_set_state_nolock()) ffff8f8dfc7db800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789584010.691230:0:3455:0:(import.c:545:import_select_connection()) MGC192.168.204.111@tcp: connect to NID 0@lo last attempt 554 00000100:00080000:0.0:1789584010.691250:0:3455:0:(import.c:666:import_select_connection()) MGC192.168.204.111@tcp: import ffff8f8dfc7db800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1789584010.691296:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253819392:0@lo:9:umount.0 00000100:00080000:3.0:1789584010.691359:0:3457:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8f8dfc7db800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:3.0:1789584010.691388:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3457:1876514253818880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789584010.691548:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584010.691610:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253819520:0@lo:9:umount.0 00000100:00100000:0.0:1789584010.691638:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584010.691681:0:17744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253819392 00000100:00100000:3.0:1789584010.691693:0:17744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253819392 00000100:00100000:0.0:1789584010.691964:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253819520 00000100:00100000:0.0:1789584010.691972:0:17747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253819520 00000100:00100000:0.0:1789584010.692049:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789584010.692628:0:17744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789584010.692640:0:17744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3453:x1876514253819392:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789584010.692671:0:17744:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868bd6 00000100:00080000:3.0:1789584010.692681:0:17744:0:(import.c:65:import_set_state_nolock()) ffff8f8df623e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789584010.692719:0:17744:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1789584010.693226:0:17744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3453:x1876514253819392:12345-0@lo:9:umount.0 Request processed in 586us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584010.693250:0:17744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789584010.693484:0:3456:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8f8dfc7db800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1789584010.693744:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3456:1876514253818752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789584010.693754:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3456:1876514253817728:0@lo:400:kworker.0 00000100:00100000:1.0:1789584010.693782:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3456:1876514253819264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789584010.694465:0:17747:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3453:x1876514253819520:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789584010.694511:0:17747:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868d42 00000100:00080000:0.0:1789584010.694525:0:17747:0:(import.c:65:import_set_state_nolock()) ffff8f8dc91ea000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789584010.694590:0:17747:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789584010.696172:0:17747:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3453:x1876514253819520:12345-0@lo:9:umount.0 Request processed in 4103us (4522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584010.696211:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1789584010.696270:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789584010.696332:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dc93a4000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789584010.696356:0:3453:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789584010.696360:0:3453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789584010.696364:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253819392:0@lo:9:umount.0 00000100:00080000:0.0:1789584010.696382:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dc6b01800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789584010.696396:0:3455:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1ac700 x1876514253819648/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:0.0:1789584010.696398:0:3453:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789584010.696401:0:3453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1789584010.696411:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789584010.696458:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3455:1876514253819136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789584010.696467:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3455:1876514253819008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789584010.697099:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253819520:0@lo:9:umount.0 00000100:00100000:0.0:1789584010.697136:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3453:1876514253819648:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1789584010.697180:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876514253819648 offset 0 length 520: 4 00000100:00080000:3.0:1789584010.700313:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789584010.700322:0:16427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000400:00000100:2.0:1789584010.706003:0:16419:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876514253818752 offset 224 length 224: 4 00000100:00100000:2.0:1789584010.706040:0:16419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3456:x1876514253818752:12345-0@lo:103:ldlm_bl.0 Request processed in 44730us (49755us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789584010.706055:0:16419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:00080000:3.0:1789584010.721713:0:20440:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8f8e009d19c0) has no exports 00000020:01000000:2.0:1789584010.788584:0:20440:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f8dc6bbf720 - data ffff8f8df89ab288/ffff8f8cc4529800 00000020:01000000:2.0:1789584010.788753:0:20440:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f8dee5f4660 - data ffff8f8dde8a6510/ffff8f8dc50a5800 00000001:00000004:2.0:1789584010.797433:0:20440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1789584010.901828:0:20440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789584010.901838:0:20440:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789584010.901846:0:20440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789584010.906726:0:20440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789584010.906734:0:20440:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789584010.906744:0:20440:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789584010.906747:0:20440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789584010.907589:0:17075:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789584010.907608:0:17075:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1789584010.907629:0:17075:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1789584010.909954:0:20440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789584010.909962:0:20440:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789584010.910533:0:20440:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789584010.910537:0:20440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789584010.913657:0:17078:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789584010.913663:0:17078:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1789584010.913673:0:17078:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1789584011.011704:0:20440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868a40 00000020:00000080:3.0:1789584011.011717:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8dd8644800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789584011.011955:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dd8644800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789584011.013458:0:20440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868a55 00000020:00000080:3.0:1789584011.013468:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8dede91800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789584011.013522:0:20440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789584011.013529:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584011.013537:0:20440:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789584011.013541:0:20440:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8f8def4b3380) has no exports 00000004:01000000:3.0:1789584011.013711:0:20440:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789584011.013719:0:20440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868aa9 00000020:00000080:3.0:1789584011.013724:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8de0009000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789584011.016488:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dede91800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1789584011.019578:0:20440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789584011.019610:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584011.019634:0:20440:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789584011.019640:0:20440:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8f8df7688000) has no exports 00000020:00000080:3.0:1789584011.019660:0:20440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868aa2 00000020:00000080:3.0:1789584011.019668:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8de0008000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1789584011.020466:0:20440:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789584011.020471:0:20440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789584011.020475:0:20440:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1789584011.020481:0:20440:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789584011.020484:0:20440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789584011.020514:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789584011.020521:0:20440:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789584011.020527:0:20440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868a94 00000020:00000080:3.0:1789584011.020532:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8de000b800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789584011.020536:0:20440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789584011.020540:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584011.020543:0:20440:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789584011.020545:0:20440:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8f8cc47799c0) has no exports 00000020:00000080:3.0:1789584011.020550:0:20440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868a86 00000020:00000080:3.0:1789584011.020552:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8dc93a3000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789584011.020891:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8de0009000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789584011.020908:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8de0008000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789584011.020915:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8dc6b01800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789584011.020921:0:8:0:(genops.c:885:class_export_put()) final put ffff8f8de000c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789584011.020923:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8de000c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789584011.020929:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789584011.021017:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8de000b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789584011.021027:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dc93a3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789584011.021546:0:20440:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789584011.021550:0:20440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789584011.021554:0:20440:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1789584011.021559:0:20440:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789584011.021561:0:20440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789584011.021617:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584011.021741:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8dc93a4000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789584011.021782:0:20440:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789584011.021854:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8dc93a5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789584011.021857:0:20440:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dc93a5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1789584011.021862:0:20440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1789584011.021928:0:20440:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789584011.021935:0:20440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868a78 00000020:00000080:3.0:1789584011.021941:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8dc93a7000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789584011.021988:0:20440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789584011.021992:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584011.022005:0:20440:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789584011.022008:0:20440:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8f8e009d0000) has no exports 00000020:00000080:3.0:1789584011.022014:0:20440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868a71 00000020:00000080:3.0:1789584011.022017:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8dd8647800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789584011.024759:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dc93a7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789584011.043011:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dd8647800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789584011.043259:0:20440:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789584011.043264:0:20440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789584011.043268:0:20440:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789584011.043276:0:20440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789584011.043335:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584011.043347:0:20440:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789584011.043378:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584011.043382:0:20440:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789584011.043387:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8cc3f50800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789584011.043390:0:20440:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc3f50800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789584011.043398:0:20440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789584011.043552:0:20440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868a5c 00000020:00000080:0.0:1789584011.043558:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8dede93800/lustre-MDD0001_UUID 00000020:01000000:0.0:1789584011.043563:0:20440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789584011.043567:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789584011.043572:0:20440:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789584011.043576:0:20440:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8f8e009d4d40) has no exports 00000020:00000080:0.0:1789584011.043630:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584011.043634:0:20440:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789584011.043639:0:20440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868a63 00000020:00000080:0.0:1789584011.043643:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8dede92800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789584011.043651:0:20440:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8def4ac000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789584011.043654:0:20440:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8def4ac000 2 00000020:01000004:0.0:1789584011.043657:0:20440:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f8def4ac000 from lustre-MDT0001 00000020:00000080:0.0:1789584011.043676:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584011.043680:0:20440:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789584011.043682:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8dd8642800/lustre-MDT0001_UUID 00000020:00000080:0.0:1789584011.043684:0:20440:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dd8642800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789584011.043691:0:20440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789584011.043717:0:20440:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789584011.043720:0:20440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789584011.043723:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789584011.043726:0:20440:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789584011.043733:0:20440:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8f8df623d800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789584011.043738:0:20440:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8f8df76899c0) has exports, disconnecting them 00000020:00080000:0.0:1789584011.043743:0:20440:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8f8df623d800), last request at 1789583915 00000020:00000080:0.0:1789584011.043747:0:20440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868ae1 00000020:00080000:0.0:1789584011.043756:0:20440:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8df623d800): rc 0 00000020:00000080:0.0:1789584011.043760:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8df623d800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789584011.043871:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8dd8644000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789584011.043879:0:8:0:(genops.c:885:class_export_put()) final put ffff8f8dede97000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789584011.043888:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dede97000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789584011.043895:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789584011.043977:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dede93800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789584011.043981:0:8:0:(genops.c:885:class_export_put()) final put ffff8f8dd8642000/lustre-MDD0001_UUID 00000020:00000080:1.0:1789584011.043983:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dd8642000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789584011.043986:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789584011.044090:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dede92800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789584011.044097:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df623d800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789584011.056252:0:20440:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789584011.056261:0:20440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789584011.056266:0:20440:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789584011.056273:0:20440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789584011.056305:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8df623f000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789584011.056463:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584011.056471:0:20440:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1789584011.056477:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8cc44bc000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1789584011.056492:0:20440:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc44bc000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1789584011.056501:0:20440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789584011.056555:0:20440:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8def4ac000 1 00000020:00000080:0.0:1789584011.056560:0:20440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868a08 00000020:00000080:0.0:1789584011.056567:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8def4ac800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1789584011.056575:0:20440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789584011.056583:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8def4ac800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789584011.056606:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789584011.056611:0:20440:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789584011.056615:0:20440:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8f8cc4778000) has no exports 00000020:00000080:0.0:1789584011.082934:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584011.082953:0:20440:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1789584011.082959:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8dee19c000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789584011.082964:0:20440:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dee19c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1789584011.082974:0:20440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789584011.083114:0:20440:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f8dee19d800 00000020:01000000:0.0:1789584011.083149:0:20440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789584011.083153:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789584011.083157:0:20440:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789584011.083162:0:20440:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8f8df72c4d40) has no exports 00000100:00100000:0.0:1789584011.083369:0:16434:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8f8dd10f2c00:16434] 2 exiting: rc = 0 00000100:00100000:2.0:1789584011.088003:0:16433:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8f8dd10f2000:16433] 1 exiting: rc = 0 00000100:00100000:2.0:1789584011.088118:0:18999:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8f8dc2f2a600:18999] 4 exiting: rc = 0 00000100:00100000:2.0:1789584011.088178:0:16432:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8f8dc8579800:16432] 0 exiting: rc = 1 00000100:00100000:2.0:1789584011.088281:0:18945:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8f8cc6d0fa00:18945] 3 exiting: rc = 0 00000100:00100000:0.0:1789584011.099582:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099608:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099615:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099620:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099630:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099636:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099642:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099648:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099654:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099660:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099666:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099685:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099691:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099696:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099702:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099706:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099711:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099717:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099725:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099732:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099738:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099745:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099751:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099757:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099762:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099768:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099903:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099912:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099918:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099924:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099929:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099934:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099939:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099964:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099970:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099977:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099982:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.099988:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100000:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100006:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100012:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100018:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100023:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100028:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100033:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100039:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100211:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100220:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100226:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100232:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100238:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100243:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100248:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100253:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100258:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100264:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100270:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100275:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100281:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100286:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100292:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100298:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100304:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.100310:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584011.113974:0:16436:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8f8cc4a3ca00:16436] 1 exiting: rc = 0 00000100:00100000:0.0:1789584011.114214:0:16435:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8f8cc4a3de00:16435] 0 exiting: rc = 1 00000100:00100000:0.0:1789584011.114407:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.114416:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.114423:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.114430:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.114435:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.114440:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.114446:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.114452:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.114457:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118221:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118246:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118252:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118258:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118264:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118269:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118275:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118305:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118311:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118318:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118324:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118329:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118335:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118340:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118344:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118349:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118354:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118359:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118368:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118375:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118927:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118937:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118942:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118948:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118954:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118959:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118965:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118970:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118976:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118982:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118987:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118992:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.118996:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119001:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119006:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119012:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119018:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119023:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119027:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119033:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119038:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119045:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119565:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119571:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119576:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119582:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119587:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119605:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119612:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119618:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119670:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119678:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119687:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119693:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.119698:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.126536:0:17344:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8f8dfac72200:17344] 2 exiting: rc = 0 00000100:00100000:3.0:1789584011.128517:0:16437:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8f8cc48cde00:16437] 0 exiting: rc = 1 00000100:00100000:2.0:1789584011.131081:0:16438:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8f8cc48cc600:16438] 1 exiting: rc = 0 00000100:00100000:0.0:1789584011.131183:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131211:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131243:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131252:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131258:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131265:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131271:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131278:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131283:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131289:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131294:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131310:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131316:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131321:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131328:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131333:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131339:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131345:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131351:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131357:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131363:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131380:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131386:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131403:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131409:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131414:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131419:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131425:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131430:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131436:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131441:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131447:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131453:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131461:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131467:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131486:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131494:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131499:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131505:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131512:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131518:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131524:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131530:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131536:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131542:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131548:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131554:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131572:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131578:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131585:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131605:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131616:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131639:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131645:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131651:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131657:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131670:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131676:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131682:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131704:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131711:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131718:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131723:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.131736:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.157880:0:16439:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8f8cc48cd400:16439] 0 exiting: rc = 1 00000100:00100000:0.0:1789584011.158112:0:16440:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8f8cc48cc800:16440] 1 exiting: rc = 0 00000100:00100000:0.0:1789584011.168306:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168317:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168323:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168328:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168334:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168339:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168345:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168350:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168357:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168362:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168367:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168373:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168378:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168383:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168389:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168396:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168401:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168406:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168411:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168416:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168421:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168425:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168430:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168435:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168440:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168460:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168465:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168470:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168475:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168480:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168484:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168488:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168492:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168498:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168504:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168509:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168513:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168518:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168523:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168528:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168533:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168538:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168544:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168549:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168554:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168559:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168565:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168569:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168574:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168580:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168585:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168603:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168610:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168615:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168621:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168626:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168631:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168637:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168642:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168659:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168673:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168678:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168683:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.168688:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177148:0:16441:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8f8dda072000:16441] 0 exiting: rc = 1 00000100:00100000:0.0:1789584011.177263:0:16442:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8f8dda072800:16442] 1 exiting: rc = 0 00000100:00100000:0.0:1789584011.177314:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177322:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177327:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177332:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177337:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177343:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177347:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177353:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177359:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177365:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177370:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177375:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177380:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177385:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177391:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177396:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177401:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177406:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177411:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177416:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177421:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177426:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177431:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177436:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177441:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177446:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177451:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177457:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177462:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177480:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177485:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177490:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177494:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177498:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177503:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177509:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177514:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177519:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177523:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177528:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177534:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177539:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177545:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177550:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177556:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177561:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177566:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177571:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177576:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177582:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177587:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177608:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177614:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177619:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177623:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177628:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177634:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177639:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177644:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177663:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177668:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177672:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177677:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.177683:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.178020:0:16443:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8f8dc729b400:16443] 0 exiting: rc = 1 00000100:00100000:2.0:1789584011.180263:0:16444:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8f8dc729a800:16444] 1 exiting: rc = 0 00000100:00100000:0.0:1789584011.181388:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181396:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181400:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181405:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181411:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181417:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181422:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181426:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181431:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181437:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181441:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181447:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181452:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181458:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181462:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181467:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181472:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181478:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181483:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181488:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181494:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181498:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181503:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181508:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181513:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181519:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181525:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181530:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181535:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181540:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181545:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181550:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181555:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181561:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181580:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.181586:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182039:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182059:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182065:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182070:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182075:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182081:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182086:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182091:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182097:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182102:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182107:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182113:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182249:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182258:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182263:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182268:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182274:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182279:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182284:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182289:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182294:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182299:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182304:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182310:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182315:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182320:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182325:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.182331:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.183389:0:16445:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8f8cc44e7400:16445] 0 exiting: rc = 1 00000100:00100000:0.0:1789584011.184312:0:16446:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8f8cc44e7e00:16446] 1 exiting: rc = 0 00000100:00100000:0.0:1789584011.188949:0:16447:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8f8cc44e7c00:16447] 2 exiting: rc = 0 00000100:00100000:0.0:1789584011.189086:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189094:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189112:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189118:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189135:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189142:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189149:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189154:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189160:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189165:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189171:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189176:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189182:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189201:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189222:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189228:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189234:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189240:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189246:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189251:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189258:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189263:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189270:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189276:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189281:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189286:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189293:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189297:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189304:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189310:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189316:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189321:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189327:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189333:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189339:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189344:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189350:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189363:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189385:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189392:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189397:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189403:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189409:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189415:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189421:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189427:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189433:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189438:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189445:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189451:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189456:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189461:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189467:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189473:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189480:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189486:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189491:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189497:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189501:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189507:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189513:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189519:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189524:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584011.189530:0:20440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789584011.205646:0:20440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584011.205659:0:20440:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789584011.205664:0:20440:0:(genops.c:885:class_export_put()) final put ffff8f8dfc7d8800/MDS_uuid 00000020:00000080:0.0:1789584011.205669:0:20440:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dfc7d8800/MDS_uuid for MDS 00000020:01000000:0.0:1789584011.205674:0:20440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789584011.205793:0:20440:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1789584011.298270:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584012.316783:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789584012.338900:0:8131:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789584012.338911:0:8131:0:(genops.c:885:class_export_put()) final put ffff8f8df623f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789584012.339164:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df623f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789584012.339228:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8df623e000 for lustre-OST0000 00000100:00080000:2.0:1789584013.275429:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) bfd2e540-776d-4d6d-9d40-7d81c66add0c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789584013.275439:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) bfd2e540-776d-4d6d-9d40-7d81c66add0c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789584013.275451:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789584013.275454:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789584013.275457:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8dc3e7f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789584013.275465:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 661 00000100:00080000:2.0:1789584013.275471:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789584013.275485:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f8dc3e7f800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1789584013.275522:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8df781ad80 x1876514253819776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789584013.275579:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789584013.275582:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789584013.275584:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8df6238000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789584013.275587:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 661 00000100:00080000:2.0:1789584013.275590:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789584013.275595:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f8df6238000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1789584013.275607:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8df7818e00 x1876514253820032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789584013.275642:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789584013.275659:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253819904:0@lo:400:kworker.0 00000400:00000100:2.0:1789584013.275711:0:3456:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514253819904 offset 0 length 224: 4 00000100:00100000:3.0:1789584013.275943:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3453:1876514253819776:0@lo:38:kworker.0 00000400:00000100:3.0:1789584013.275968:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514253819776 offset 0 length 520: 4 00000100:00100000:3.0:1789584013.275982:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3453:1876514253820032:0@lo:38:kworker.0 00000400:00000100:3.0:1789584013.275996:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514253820032 offset 0 length 520: 4 00000100:00100000:3.0:1789584013.276037:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3454:1876514253820160:0@lo:400:kworker.0 00000400:00000100:3.0:1789584013.276057:0:3454:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514253820160 offset 0 length 224: 4 00010000:00010000:0.0:1789584013.339581:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789584013.827352:0:9074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789584013.827362:0:9074:0:(genops.c:885:class_export_put()) final put ffff8f8dc91ec800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789584013.833727:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dc91ec800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789584013.833777:0:12001:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8dc91ea000 for lustre-OST0001 00010000:00010000:0.0:1789584014.363309:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789584014.506427:0:20594:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789584014.519537:0:20594:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789584014.522116:0:20594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8400/0x113b6add9f868b7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f868b82 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584014.522134:0:20594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8400/0x113b6add9f868b7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f868b82 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584014.522142:0:20594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8400/0x113b6add9f868b7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868b82 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584014.522149:0:20594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8400/0x113b6add9f868b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868b82 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584014.522169:0:20594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789584014.522175:0:20594:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789584014.522243:0:20594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789584014.522254:0:20594:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8df781ad80 x1876514253819776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789584033 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584014.522294:0:20594:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789584014.522330:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dc3e7f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789584014.522335:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1789584014.522339:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3453:1876514253819776:0@lo:38:kworker.0 00000100:00080000:3.0:1789584014.522370:0:20594:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789584014.522384:0:20594:0:(import.c:65:import_set_state_nolock()) ffff8f8dc3e7f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789584014.522390:0:20594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789584014.522392:0:20594:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789584014.522395:0:20594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789584014.523219:0:16420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789584014.523229:0:16420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8400/0x113b6add9f868b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868b82 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584014.523247:0:16420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8400 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:1.0:1789584014.523258:0:16420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8400/0x113b6add9f868b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868b82 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584014.523269:0:16420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8400/0x113b6add9f868b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868b82 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789584014.523277:0:16420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8400/0x113b6add9f868b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868b82 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584014.523283:0:16420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:3.0:1789584014.523292:0:20594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 10000000:01000000:1.0:1789584014.523296:0:16420:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789584014.523300:0:16420:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1789584014.523301:0:20594:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8df7818700 x1876514253819904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584029 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789584014.523316:0:16420:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8dfc7db800 00000100:00100000:3.0:1789584014.523318:0:20594:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1789584014.523322:0:16420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8400/0x113b6add9f868b7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x113b6add9f868b82 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789584014.523324:0:20594:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00010000:00010000:1.0:1789584014.523334:0:16420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8400/0x113b6add9f868b7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x113b6add9f868b82 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789584014.523347:0:20594:0:(import.c:65:import_set_state_nolock()) ffff8f8cc576f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789584014.523347:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584014.523351:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584014.523353:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584014.523377:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3453:1876514253820288:0@lo:39:umount.0 00000100:00100000:1.0:1789584014.523387:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253819904:0@lo:400:kworker.0 00000400:00000100:3.0:1789584014.523428:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514253820288 offset 0 length 224: 4 00000100:00080000:2.0:1789584015.323543:0:20556:0:(pinger.c:229:ptlrpc_pinger_process_import()) bfd2e540-776d-4d6d-9d40-7d81c66add0c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789584015.323553:0:20556:0:(pinger.c:247:ptlrpc_pinger_process_import()) bfd2e540-776d-4d6d-9d40-7d81c66add0c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789584015.323557:0:20556:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789584015.323560:0:20556:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789584015.323732:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789584015.323752:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3454:1876514253820416:0@lo:400:kworker.0 00000400:00000100:3.0:1789584015.323822:0:3454:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514253820416 offset 0 length 224: 4 00010000:00010000:0.0:1789584015.387361:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584016.412244:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584017.435539:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789584018.333449:0:20556:0:(pinger.c:229:ptlrpc_pinger_process_import()) bfd2e540-776d-4d6d-9d40-7d81c66add0c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789584018.333469:0:20556:0:(pinger.c:247:ptlrpc_pinger_process_import()) bfd2e540-776d-4d6d-9d40-7d81c66add0c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789584018.333472:0:20556:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789584018.333476:0:20556:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789584018.333603:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789584018.333625:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3457:1876514253820544:0@lo:400:kworker.0 00000400:00000100:3.0:1789584018.333692:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514253820544 offset 0 length 224: 4 00010000:00010000:1.0:1789584018.459564:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584019.483574:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584020.510616:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584020.699564:0:3453:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789584010/real 1789584010] req@ffff8f8dee1ac700 x1876514253819648/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789584020 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584020.699594:0:3453:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8dee1ac700 x1876514253819648/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789584020 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789584020.699614:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dfc7db800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584020.707539:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789584020.707552:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3453:1876514253819648:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1789584020.707781:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) bfd2e540-776d-4d6d-9d40-7d81c66add0c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789584020.707787:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789584020.707790:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f8dfc7db800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789584020.707796:0:8:0:(import.c:545:import_select_connection()) MGC192.168.204.111@tcp: connect to NID 0@lo last attempt 663 00000100:00080000:1.0:1789584020.707800:0:8:0:(import.c:630:import_select_connection()) MGC192.168.204.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789584020.707812:0:8:0:(import.c:666:import_select_connection()) MGC192.168.204.111@tcp: import ffff8f8dfc7db800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584020.707852:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1ace00 x1876514253820672/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789584020.707879:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789584020.707883:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789584020.708443:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789584020.708462:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3456:1876514253820800:0@lo:400:kworker.0 00000400:00000100:2.0:1789584020.708512:0:3456:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514253820800 offset 0 length 224: 4 00000100:00100000:0.0:1789584020.709381:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3453:1876514253820672:0@lo:250:kworker.0 00000400:00000100:0.0:1789584020.709427:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876514253820672 offset 0 length 520: 4 00010000:00010000:0.0:1789584021.531351:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584022.557961:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584023.579362:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584024.603548:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584024.795358:0:3453:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789584014/real 1789584014] req@ffff8f8dc4c5ea00 x1876514253820288/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789584024 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584024.795394:0:3453:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8dc4c5ea00 x1876514253820288/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789584024 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789584024.795431:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc576f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789584024.795456:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3453:1876514253820288:0@lo:39:umount.0 00000100:00080000:3.0:1789584024.795552:0:20594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789584024.795557:0:20594:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789584024.795561:0:20594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789584024.796605:0:20594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f868b51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f868b58 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584024.796619:0:20594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f868b51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f868b58 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584024.796627:0:20594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f868b51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868b58 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584024.796634:0:20594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f868b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868b58 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584024.796656:0:20594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789584024.796664:0:20594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e400/0x113b6add9f868eb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f868ebc expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584024.796670:0:20594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e400/0x113b6add9f868eb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f868ebc expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584024.796677:0:20594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e400/0x113b6add9f868eb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868ebc expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584024.796683:0:20594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e400/0x113b6add9f868eb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868ebc expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584024.796700:0:20594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789584024.796704:0:20594:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789584024.796733:0:20594:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789584024.796736:0:20594:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789584024.796740:0:20594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584024.796746:0:20594:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789584024.796750:0:20594:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8f8cc477cd40) has no exports 00000020:00080000:3.0:1789584024.796774:0:20594:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8f8cc477cd40) has no exports 00010000:00010000:1.0:1789584024.798771:0:16420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789584024.798785:0:16420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f868b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868b58 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584024.798797:0:16420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8800 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:1.0:1789584024.798801:0:16420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f868b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868b58 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584024.798812:0:16420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f868b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868b58 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789584024.798819:0:16420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f868b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868b58 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584024.798826:0:16420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789584024.798829:0:16420:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789584024.798832:0:16420:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789584024.798852:0:16420:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8dfc7db800 00010000:00010000:1.0:1789584024.798856:0:16420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f868b51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x113b6add9f868b58 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584024.798863:0:16420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f868b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x113b6add9f868b58 expref: -99 pid: 17743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584024.798879:0:16420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789584024.798883:0:16420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e400/0x113b6add9f868eb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868ebc expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584024.798889:0:16420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5e400 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:1.0:1789584024.798891:0:16420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e400/0x113b6add9f868eb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868ebc expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584024.798915:0:16420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e400/0x113b6add9f868eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868ebc expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789584024.798921:0:16420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e400/0x113b6add9f868eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868ebc expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584024.798927:0:16420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789584024.798929:0:16420:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789584024.798931:0:16420:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789584024.798938:0:16420:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8dfc7db800 00010000:00010000:1.0:1789584024.798941:0:16420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e400/0x113b6add9f868eb5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x113b6add9f868ebc expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584024.798948:0:16420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e400/0x113b6add9f868eb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x113b6add9f868ebc expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584024.798971:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584024.798973:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584024.798974:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584024.799378:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789584024.801389:0:20594:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f8dc6bbf000 - data ffff8f8dde84de58/ffff8f8cc4528400 00000020:01000000:3.0:1789584024.801624:0:20594:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f8dc9230900 - data ffff8f8dffe9fca8/ffff8f8dc4e54400 00100000:10000000:3.0:1789584024.808367:0:20594:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789584024.832858:0:20594:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868b66 00000020:00000080:2.0:1789584024.832868:0:20594:0:(genops.c:885:class_export_put()) final put ffff8f8cc4c64800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789584024.832892:0:20594:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8cc3f54800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789584024.832896:0:20594:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8cc3f54800 2 00000020:01000004:2.0:1789584024.832899:0:20594:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f8cc3f54800 from lustre-OST0000 00000020:00000080:2.0:1789584024.832930:0:20594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789584024.832939:0:20594:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789584024.832954:0:20594:0:(genops.c:885:class_export_put()) final put ffff8f8df6ece000/lustre-OST0000_UUID 00000020:00000080:2.0:1789584024.832957:0:20594:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df6ece000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789584024.832964:0:20594:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789584024.833010:0:20594:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789584024.833014:0:20594:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789584024.833018:0:20594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789584024.833022:0:20594:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789584024.833029:0:20594:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8f8df6ecd800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789584024.833035:0:20594:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff8f8de0918000) has exports, disconnecting them 00000020:00080000:2.0:1789584024.833040:0:20594:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8f8df6ecd800), last request at 1789583930 00000020:00000080:2.0:1789584024.833044:0:20594:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868b90 00000020:00080000:2.0:1789584024.833053:0:20594:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8df6ecd800): rc 0 00000020:00000080:2.0:1789584024.833058:0:20594:0:(genops.c:885:class_export_put()) final put ffff8f8df6ecd800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789584024.834319:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc4c64800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789584024.834346:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df6ecd800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789584024.835270:0:20594:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789584024.835277:0:20594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789584024.835282:0:20594:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789584024.835289:0:20594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789584024.835524:0:20594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789584024.835533:0:20594:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1789584024.835538:0:20594:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789584024.835543:0:20594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584024.835547:0:20594:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789584024.835555:0:20594:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8f8cc576a000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789584024.835561:0:20594:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff8f8de091b380) has exports, disconnecting them 00000020:00080000:3.0:1789584024.835566:0:20594:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8f8cc576a000), last request at 1789583930 00000020:00000080:3.0:1789584024.835570:0:20594:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868ba5 00000020:00080000:3.0:1789584024.835585:0:20594:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8cc576a000): rc 0 00000020:00000080:3.0:1789584024.835591:0:20594:0:(genops.c:885:class_export_put()) final put ffff8f8cc576a000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789584024.836649:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8dc3e7f800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789584024.836660:0:8:0:(genops.c:885:class_export_put()) final put ffff8f8df6eca800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789584024.836663:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df6eca800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789584024.836670:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789584024.836729:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc576a000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1789584024.867279:0:20594:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789584024.867287:0:20594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789584024.867291:0:20594:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789584024.867299:0:20594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789584024.867346:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8cc576f000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789584024.867551:0:20594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584024.867560:0:20594:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1789584024.867566:0:20594:0:(genops.c:885:class_export_put()) final put ffff8f8df6ece800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1789584024.867569:0:20594:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df6ece800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1789584024.867579:0:20594:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1789584024.867632:0:20594:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8cc3f54800 1 00000020:00000080:0.0:1789584024.867639:0:20594:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868b43 00000020:00000080:0.0:1789584024.867645:0:20594:0:(genops.c:885:class_export_put()) final put ffff8f8dc3e7f000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789584024.867654:0:20594:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789584024.867662:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dc3e7f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789584024.867671:0:20594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789584024.867686:0:20594:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789584024.867691:0:20594:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff8f8e009d3380) has no exports 00000020:00000080:0.0:1789584024.917158:0:20594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584024.917175:0:20594:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789584024.917182:0:20594:0:(genops.c:885:class_export_put()) final put ffff8f8de000e800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789584024.917212:0:20594:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8de000e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789584024.917221:0:20594:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789584024.918289:0:20594:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f8de0009800 00000020:02000400:0.0:1789584024.918359:0:20594:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789584025.628606:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789584026.084047:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) bfd2e540-776d-4d6d-9d40-7d81c66add0c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789584026.084057:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) bfd2e540-776d-4d6d-9d40-7d81c66add0c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789584026.084060:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789584026.084062:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789584026.084218:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3454:1876514253820928:0@lo:400:kworker.0 00000400:00000100:3.0:1789584026.084275:0:3454:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514253820928 offset 0 length 224: 4 00010000:00010000:0.0:1789584026.654373:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584027.675415:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789584027.999035:0:20746:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789584028.015623:0:20746:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789584028.015747:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f5600/0x113b6add9f868c15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f868c1c expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584028.015785:0:20746:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f5600/0x113b6add9f868c15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f868c1c expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584028.015794:0:20746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f5600/0x113b6add9f868c15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868c1c expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584028.015803:0:20746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f5600/0x113b6add9f868c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868c1c expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584028.015831:0:20746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789584028.015838:0:20746:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789584028.015871:0:20746:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789584028.015888:0:20746:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8df7818e00 x1876514253820032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789584033 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584028.015919:0:20746:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789584028.015927:0:20746:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789584028.015935:0:20746:0:(import.c:65:import_set_state_nolock()) ffff8f8df6238000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789584028.015942:0:20746:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789584028.015947:0:20746:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8df7818e00 x1876514253820032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789584033 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584028.015954:0:20746:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789584028.015958:0:20746:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1789584028.015994:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3453:1876514253820032:0@lo:38:kworker.0 00000100:00080000:3.0:1789584028.017337:0:20746:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00010000:00010000:0.0:1789584028.017488:0:16421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584028.017502:0:16421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f5600/0x113b6add9f868c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868c1c expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584028.017514:0:16421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dee6f5600 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:0.0:1789584028.017520:0:16421:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f5600/0x113b6add9f868c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868c1c expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584028.017532:0:16421:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f5600/0x113b6add9f868c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868c1c expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789584028.017541:0:16421:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f5600/0x113b6add9f868c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868c1c expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789584028.017548:0:16421:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789584028.017551:0:16421:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789584028.017555:0:16421:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789584028.017575:0:16421:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8dfc7db800 00010000:00010000:0.0:1789584028.017579:0:16421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f5600/0x113b6add9f868c15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x113b6add9f868c1c expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584028.017587:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8dee6f5600/0x113b6add9f868c15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x113b6add9f868c1c expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584028.017622:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584028.017624:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584028.017626:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584028.021555:0:20746:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8df7819c00 x1876514253820160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584029 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584028.021604:0:20746:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8df7818380 x1876514253820416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584031 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584028.021645:0:20746:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8dee1a9500 x1876514253820544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584034 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584028.021668:0:20746:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8dee1af100 x1876514253820800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584036 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584028.021684:0:20746:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8dee1adc00 x1876514253820928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584042 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584028.021706:0:20746:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789584028.021718:0:20746:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789584028.021757:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3457:1876514253820544:0@lo:400:kworker.0 00000100:00080000:3.0:1789584028.021765:0:20746:0:(import.c:65:import_set_state_nolock()) ffff8f8cc5769000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789584028.021888:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3456:1876514253820800:0@lo:400:kworker.0 00000100:00100000:0.0:1789584028.021899:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3454:1876514253820928:0@lo:400:kworker.0 00000100:00100000:0.0:1789584028.021912:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3454:1876514253820416:0@lo:400:kworker.0 00000100:00100000:0.0:1789584028.021925:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3454:1876514253820160:0@lo:400:kworker.0 00000100:00100000:0.0:1789584028.021999:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3453:1876514253821056:0@lo:39:umount.0 00000400:00000100:0.0:1789584028.022059:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514253821056 offset 0 length 224: 4 00010000:00010000:2.0:1789584028.701209:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584029.723386:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584030.749167:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789584031.195410:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) bfd2e540-776d-4d6d-9d40-7d81c66add0c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789584031.195421:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) bfd2e540-776d-4d6d-9d40-7d81c66add0c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789584031.772264:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584032.795615:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584033.819818:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584034.843518:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584035.228018:0:3453:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789584020/real 1789584020] req@ffff8f8dee1ace00 x1876514253820672/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789584035 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584035.228058:0:3453:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8dee1ace00 x1876514253820672/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789584035 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789584035.228081:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dfc7db800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584035.228109:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789584035.228114:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3453:1876514253820672:0@lo:250:kworker.0 00000100:00080000:2.0:1789584035.228265:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) bfd2e540-776d-4d6d-9d40-7d81c66add0c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789584035.228277:0:12001:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789584035.228281:0:12001:0:(import.c:65:import_set_state_nolock()) ffff8f8dfc7db800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789584035.228291:0:12001:0:(import.c:545:import_select_connection()) MGC192.168.204.111@tcp: connect to NID 0@lo last attempt 674 00000100:00080000:2.0:1789584035.228299:0:12001:0:(import.c:630:import_select_connection()) MGC192.168.204.111@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789584035.228313:0:12001:0:(import.c:666:import_select_connection()) MGC192.168.204.111@tcp: import ffff8f8dfc7db800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1789584035.228361:0:12001:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8df781b800 x1876514253821184/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789584035.228476:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3453:1876514253821184:0@lo:250:kworker.0 00000400:00000100:0.0:1789584035.228545:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876514253821184 offset 0 length 520: 4 00010000:00010000:0.0:1789584035.868919:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584036.893207:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584037.915736:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584038.299337:0:3453:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789584028/real 1789584028] req@ffff8f8dc4c5ce00 x1876514253821056/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789584038 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584038.299371:0:3453:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8dc4c5ce00 x1876514253821056/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789584038 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789584038.299391:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc5769000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789584038.299418:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3453:1876514253821056:0@lo:39:umount.0 00000100:00080000:3.0:1789584038.299754:0:20746:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789584038.299760:0:20746:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789584038.299766:0:20746:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789584038.301096:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df52e7a00/0x113b6add9f868beb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f868bf2 expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584038.301114:0:20746:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df52e7a00/0x113b6add9f868beb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f868bf2 expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584038.301120:0:20746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df52e7a00/0x113b6add9f868beb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868bf2 expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584038.301127:0:20746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8df52e7a00/0x113b6add9f868beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868bf2 expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584038.301156:0:20746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789584038.301180:0:20746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e000/0x113b6add9f868ea7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f868eae expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584038.301215:0:20746:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e000/0x113b6add9f868ea7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f868eae expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584038.301221:0:20746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e000/0x113b6add9f868ea7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868eae expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584038.301226:0:20746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e000/0x113b6add9f868ea7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x113b6add9f868eae expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584038.301245:0:20746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789584038.301703:0:16420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789584038.301712:0:16420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8df52e7a00/0x113b6add9f868beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868bf2 expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584038.301720:0:16420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df52e7a00 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:2.0:1789584038.301723:0:16420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8df52e7a00/0x113b6add9f868beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868bf2 expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584038.301732:0:16420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8df52e7a00/0x113b6add9f868beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868bf2 expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789584038.301740:0:16420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8df52e7a00/0x113b6add9f868beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868bf2 expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789584038.301744:0:16420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789584038.301747:0:16420:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789584038.301759:0:16420:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8dfc7db800 00010000:00010000:2.0:1789584038.301763:0:16420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8df52e7a00/0x113b6add9f868beb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x113b6add9f868bf2 expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584038.301783:0:16420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8df52e7a00/0x113b6add9f868beb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x113b6add9f868bf2 expref: -99 pid: 18466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584038.301799:0:16420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789584038.301802:0:16420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e000/0x113b6add9f868ea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868eae expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584038.301807:0:16420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5e000 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:2.0:1789584038.301810:0:16420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e000/0x113b6add9f868ea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x113b6add9f868eae expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584038.301816:0:16420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e000/0x113b6add9f868ea7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868eae expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789584038.301821:0:16420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e000/0x113b6add9f868ea7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868eae expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789584038.301825:0:16420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789584038.301827:0:16420:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789584038.301831:0:16420:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8dfc7db800 00010000:00010000:2.0:1789584038.301834:0:16420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e000/0x113b6add9f868ea7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x113b6add9f868eae expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584038.301839:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584038.301840:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584038.301842:0:16420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584038.302347:0:16421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584038.307144:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8defc5e000/0x113b6add9f868ea7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x113b6add9f868eae expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789584038.307173:0:20746:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1789584038.307182:0:20746:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1789584038.307215:0:20746:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789584038.308270:0:20746:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789584038.308278:0:20746:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789584038.308289:0:20746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584038.308296:0:20746:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789584038.308301:0:20746:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff8f8cc47b4d40) has no exports 00000020:00080000:3.0:1789584038.308334:0:20746:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff8f8cc47b4d40) has no exports 00000020:01000000:3.0:1789584038.314358:0:20746:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f8dc6bbf1e0 - data ffff8f8dfc1a5798/ffff8f8dc4ebcc00 00000020:01000000:3.0:1789584038.314932:0:20746:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f8dfd26d1e0 - data ffff8f8dde8a4ca8/ffff8f8cc5602400 00100000:10000000:3.0:1789584038.325381:0:20746:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789584038.412719:0:20746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868c00 00000020:00000080:0.0:1789584038.412728:0:20746:0:(genops.c:885:class_export_put()) final put ffff8f8cc6c84800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789584038.412740:0:20746:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8cc576a800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789584038.412743:0:20746:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8cc576a800 2 00000020:01000004:0.0:1789584038.412746:0:20746:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f8cc576a800 from lustre-OST0001 00000020:00000080:0.0:1789584038.412772:0:20746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584038.412781:0:20746:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789584038.412784:0:20746:0:(genops.c:885:class_export_put()) final put ffff8f8df7695800/lustre-OST0001_UUID 00000020:00000080:0.0:1789584038.412787:0:20746:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df7695800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789584038.412793:0:20746:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:3.0:1789584038.412815:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc6c84800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1789584038.412887:0:20746:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import bfd2e540-776d-4d6d-9d40-7d81c66add0c->MGS 00010000:00010000:0.0:1789584038.412902:0:20746:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8defc5f200/0x113b6add9f868a0f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868a16 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789584038.413646:0:20746:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8defc5f200/0x113b6add9f868a0f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868a16 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789584038.413654:0:20746:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789584038.413657:0:20746:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789584038.413660:0:20746:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789584038.413673:0:20746:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8dfc7db800 00010000:00010000:0.0:1789584038.413677:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8defc5f200/0x113b6add9f868a0f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x113b6add9f868a16 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584038.413708:0:20746:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8c00/0x113b6add9f8688fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x113b6add9f868905 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789584038.413715:0:20746:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8c00/0x113b6add9f8688fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x113b6add9f868905 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789584038.413720:0:20746:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789584038.413722:0:20746:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789584038.413724:0:20746:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789584038.413733:0:20746:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f8dfc7db800 00010000:00010000:0.0:1789584038.413735:0:20746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8c00/0x113b6add9f8688fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x113b6add9f868905 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789584038.413751:0:20746:0:(import.c:65:import_set_state_nolock()) ffff8f8dfc7db800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789584038.413754:0:20746:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789584038.413757:0:20746:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789584038.413758:0:20746:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789584038.413763:0:20746:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789584038.413799:0:20746:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f8df781b800 x1876514253821184/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789584055 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789584038.413861:0:20746:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789584038.413864:0:20746:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:1.0:1789584038.414554:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bfd2e540-776d-4d6d-9d40-7d81c66add0c:3453:1876514253821184:0@lo:250:kworker.0 10000000:01000000:0.0:1789584038.414907:0:20746:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789584038.414916:0:20746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f8688e9 00000020:00000080:0.0:1789584038.414922:0:20746:0:(genops.c:885:class_export_put()) final put ffff8f8dfc7df800/bfd2e540-776d-4d6d-9d40-7d81c66add0c 00000020:01000000:0.0:1789584038.414945:0:20746:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.111@tcp (flags='') 00000020:00000080:0.0:1789584038.414950:0:20746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789584038.414956:0:20746:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.111@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789584038.414960:0:20746:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8f8df72c0000) has no exports 00000020:00000080:3.0:1789584038.416123:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dfc7df800/bfd2e540-776d-4d6d-9d40-7d81c66add0c for MGC192.168.204.111@tcp 10000000:01000000:1.0:1789584038.418073:0:16428:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789584038.418097:0:20746:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.111@tcp: client import never connected 00000100:00080000:0.0:1789584038.418116:0:20746:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789584038.418120:0:20746:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789584038.418124:0:20746:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789584038.418126:0:20746:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789584038.418259:0:20746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584038.418269:0:20746:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.111@tcp (uuid bfd2e540-776d-4d6d-9d40-7d81c66add0c) 00000020:01000000:0.0:1789584038.418277:0:20746:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789584038.418281:0:20746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789584038.418286:0:20746:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789584038.418293:0:20746:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8f8cc6c81800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789584038.418300:0:20746:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff8f8de09199c0) has exports, disconnecting them 00000020:00080000:0.0:1789584038.418306:0:20746:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8f8cc6c81800), last request at 1789583946 00000020:00000080:0.0:1789584038.418310:0:20746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868c46 00000020:00080000:0.0:1789584038.418324:0:20746:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8cc6c81800): rc 0 00000020:00000080:0.0:1789584038.418329:0:20746:0:(genops.c:885:class_export_put()) final put ffff8f8cc6c81800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789584038.420362:0:12001:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8dfc7db800 for MGC192.168.204.111@tcp 00000020:00000080:3.0:1789584038.420375:0:12001:0:(genops.c:885:class_export_put()) final put ffff8f8dfc7dc800/bfd2e540-776d-4d6d-9d40-7d81c66add0c 00000020:00000080:3.0:1789584038.420378:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dfc7dc800/bfd2e540-776d-4d6d-9d40-7d81c66add0c for MGC192.168.204.111@tcp 00000020:01000000:3.0:1789584038.420385:0:12001:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.111@tcp (bfd2e540-776d-4d6d-9d40-7d81c66add0c) 00000020:00000080:3.0:1789584038.422445:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc6c81800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789584038.423243:0:20746:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789584038.423248:0:20746:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789584038.423252:0:20746:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789584038.423258:0:20746:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789584038.423406:0:20746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789584038.423415:0:20746:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789584038.423420:0:20746:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789584038.423425:0:20746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789584038.423429:0:20746:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789584038.423438:0:20746:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8f8cc5477000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789584038.423445:0:20746:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff8f8cc5cc99c0) has exports, disconnecting them 00000020:00080000:0.0:1789584038.423449:0:20746:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8f8cc5477000), last request at 1789583946 00000020:00000080:0.0:1789584038.423453:0:20746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868cc4 00000020:00080000:0.0:1789584038.423466:0:20746:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f8cc5477000): rc 0 00000020:00000080:0.0:1789584038.423479:0:20746:0:(genops.c:885:class_export_put()) final put ffff8f8cc5477000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1789584038.424235:0:12001:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8df6238000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789584038.424244:0:12001:0:(genops.c:885:class_export_put()) final put ffff8f8cc4af1800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789584038.424247:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc4af1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789584038.424253:0:12001:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789584038.424304:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8cc5477000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1789584038.468596:0:20746:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789584038.468609:0:20746:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789584038.468615:0:20746:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789584038.468623:0:20746:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789584038.468660:0:12001:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f8cc5769000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789584038.472521:0:16420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789584038.479544:0:16421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1789584038.479721:0:16415:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8f8cc4a3c000:16415] 0 exiting: rc = 1 00000100:00100000:2.0:1789584038.481596:0:16416:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8f8defd4ee00:16416] 1 exiting: rc = 0 00000100:00100000:3.0:1789584038.481753:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.482040:0:16417:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8f8dc6bba000:16417] 0 exiting: rc = 1 00000100:00100000:1.0:1789584038.482319:0:16418:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8f8dc6bba800:16418] 1 exiting: rc = 0 00000100:00100000:1.0:1789584038.482386:0:17493:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8f8dfac73e00:17493] 3 exiting: rc = 0 00000100:00100000:2.0:1789584038.493372:0:16419:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8f8dc6bbae00:16419] 2 exiting: rc = 0 00000100:00100000:3.0:1789584038.493591:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493601:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493607:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493614:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493620:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493627:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493634:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493639:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493645:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493650:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493655:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493660:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493666:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493671:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493676:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493680:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493686:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493698:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493702:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493708:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493713:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493717:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493722:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493727:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493732:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493737:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493742:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493747:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493752:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493757:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493762:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493767:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493771:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493775:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493780:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493784:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493789:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493793:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493798:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493802:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493807:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493811:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493816:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493820:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493825:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493829:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493834:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493839:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493843:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493848:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493852:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493856:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493865:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493870:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493875:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493879:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493889:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493895:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493900:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493905:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493910:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493914:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493919:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.493923:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789584038.494660:0:20746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789584038.494669:0:20746:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1789584038.494675:0:20746:0:(genops.c:885:class_export_put()) final put ffff8f8df7694000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1789584038.494678:0:20746:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df7694000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1789584038.494684:0:20746:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1789584038.494720:0:20746:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8cc576a800 1 00000020:00000080:3.0:1789584038.494725:0:20746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x113b6add9f868be4 00000020:00000080:3.0:1789584038.494732:0:20746:0:(genops.c:885:class_export_put()) final put ffff8f8df6ecb800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789584038.494741:0:20746:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789584038.494751:0:12001:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8df6ecb800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789584038.494761:0:20746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584038.494765:0:20746:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789584038.494769:0:20746:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff8f8de091cd40) has no exports 00000020:00000080:3.0:1789584038.523288:0:20746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789584038.523306:0:20746:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789584038.523312:0:20746:0:(genops.c:885:class_export_put()) final put ffff8f8dc3e78800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789584038.523317:0:20746:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dc3e78800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789584038.523331:0:20746:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789584038.523508:0:20746:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f8df622c800 00000020:01000000:3.0:1789584038.523547:0:20746:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789584038.523561:0:20746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789584038.523567:0:20746:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789584038.523571:0:20746:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8f8e009bb380) has no exports 00000020:00000080:3.0:1789584038.523593:0:20746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789584038.523600:0:20746:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789584038.523603:0:20746:0:(genops.c:885:class_export_put()) final put ffff8f8dc3e7b800/OSS_uuid 00000020:00000080:3.0:1789584038.523605:0:20746:0:(genops.c:844:class_export_destroy()) destroying export ffff8f8dc3e7b800/OSS_uuid for OSS 00000020:01000000:3.0:1789584038.523611:0:20746:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789584038.523684:0:17744:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8f8dc3f88400:17744] 0 exiting: rc = 1 00000100:00100000:0.0:1789584038.523821:0:17747:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8f8cc4443a00:17747] 2 exiting: rc = 0 00000100:00100000:0.0:1789584038.523880:0:17746:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8f8dc3f88800:17746] 1 exiting: rc = 0 00000100:00080000:2.0:1789584038.523927:0:16427:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789584038.523927:0:18217:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8f8dc419ba00:18217] 3 exiting: rc = 0 00000100:00100000:0.0:1789584038.523987:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.523996:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524001:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524006:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524012:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524021:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524027:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524032:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524040:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524046:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524072:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524079:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524085:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524092:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524097:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524105:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524110:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524117:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524122:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524130:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524135:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524141:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524146:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524158:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524164:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524169:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524173:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524178:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524183:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524209:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524217:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524222:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524227:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524233:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524240:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524247:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524253:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524258:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524263:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524268:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524273:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524278:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524287:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524293:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524299:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524305:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524310:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524315:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524321:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524332:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524339:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524349:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524356:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524361:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524366:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524370:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524375:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524380:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524390:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524395:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524399:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524404:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524408:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.524413:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789584038.525501:0:17749:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8f8dc3f89000:17749] 1 exiting: rc = 0 00000100:00100000:2.0:1789584038.531416:0:17748:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8f8cc4443c00:17748] 0 exiting: rc = 1 00000100:00100000:1.0:1789584038.532635:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532645:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532650:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532655:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532661:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532665:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532670:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532678:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532684:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532689:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532694:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532699:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532704:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532710:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532716:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532721:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532727:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532731:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532736:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532741:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532746:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532752:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532757:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532762:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532768:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532773:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532778:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532783:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532789:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532811:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532816:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532822:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532827:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532832:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532837:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532841:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532846:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532851:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532856:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532861:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532867:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532872:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532877:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532882:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532887:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532892:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532897:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532902:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532908:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532913:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532918:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532923:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532928:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532933:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532939:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532944:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532950:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532955:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532960:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532965:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532971:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532977:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532982:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.532987:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789584038.536097:0:17751:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8f8dfac47800:17751] 1 exiting: rc = 0 00000100:00100000:2.0:1789584038.541150:0:17752:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8f8dc7cfb200:17752] 2 exiting: rc = 0 00000100:00100000:3.0:1789584038.549058:0:17750:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8f8df04c0400:17750] 0 exiting: rc = 1 00000100:00100000:1.0:1789584038.549245:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549253:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549267:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549273:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549279:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549284:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549289:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549294:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549300:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549305:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549311:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549316:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549321:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549325:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549330:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549335:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549339:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549344:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549348:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549366:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549372:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549376:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549381:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549386:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549392:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549396:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549401:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549407:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549412:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549417:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549422:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549427:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549432:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549437:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549442:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549457:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549462:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549467:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549472:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549477:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549483:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549488:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549492:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549508:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549513:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549529:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549536:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549542:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549548:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549553:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549558:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549563:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549568:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549573:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549578:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549583:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549588:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549593:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549599:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549604:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549608:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549614:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549619:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.549624:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555003:0:17753:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8f8dfd0b3000:17753] 0 exiting: rc = 1 00000100:00100000:1.0:1789584038.555099:0:17754:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8f8dfd0b2400:17754] 1 exiting: rc = 0 00000100:00100000:1.0:1789584038.555145:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555151:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555156:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555161:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555178:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555183:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555205:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555210:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555215:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555220:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555225:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555230:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555234:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555239:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555243:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555247:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555252:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555255:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555259:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555263:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555268:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555272:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555276:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555280:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555284:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555289:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555294:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555298:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555303:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555314:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555329:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555334:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555338:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555343:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555347:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555351:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555358:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555363:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555368:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555377:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555381:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555386:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555391:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555395:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555400:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555404:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555409:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555413:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555417:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555421:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555425:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555429:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555434:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555439:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555444:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555448:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555457:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555462:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555466:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555470:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555475:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555479:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555484:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.555489:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.558948:0:17755:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8f8dfd0b2800:17755] 0 exiting: rc = 1 00000100:00100000:3.0:1789584038.561218:0:17756:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8f8de0901400:17756] 1 exiting: rc = 0 00000100:00100000:1.0:1789584038.561321:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561330:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561337:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561343:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561376:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561384:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561390:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561403:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561412:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561432:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561443:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561449:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561454:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561459:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561465:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561471:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561490:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561498:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561504:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561509:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561516:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561602:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561609:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561616:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561622:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561627:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561632:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561637:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561655:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561663:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561668:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561675:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561682:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561687:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561693:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561699:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561705:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561711:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561717:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561722:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561746:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561754:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561760:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561765:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561778:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561784:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561790:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561795:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561802:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561808:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561819:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561825:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561847:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561855:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561861:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561869:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561875:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561882:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561888:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561893:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561901:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561906:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561912:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789584038.561918:0:20746:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789584038.580219:0:20746:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789584063.049381:0:21464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789584074.265258:0:21927:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789584074.265264:0:21927:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789584074.265390:0:21927:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f8dff997800 00000020:01000004:1.0:1789584074.265404:0:21927:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789584074.265413:0:21927:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789584074.265428:0:21927:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8f8cc47b19c0) 00000020:00000080:1.0:1789584074.265441:0:21927:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789584074.304176:0:21927:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789584074.311135:0:21927:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:2.0:1789584074.314582:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 409: rc = 0 00100000:10000000:2.0:1789584074.314728:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 409: rc = 0 00100000:10000000:2.0:1789584074.318229:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0001 under 409: rc = 0 00100000:10000000:2.0:1789584074.318528:0:21927:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789584074.318612:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 409: rc = 0 00100000:10000000:2.0:1789584074.318717:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 409: rc = 0 00100000:10000000:2.0:1789584074.319289:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 409: rc = 0 00100000:10000000:2.0:1789584074.319418:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 409: rc = 0 00100000:10000000:2.0:1789584074.324337:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 411: rc = 0 00100000:10000000:2.0:1789584074.329416:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:2.0:1789584074.329642:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:2.0:1789584074.330642:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 778: rc = 0 00100000:10000000:2.0:1789584074.331073:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 778: rc = 0 00100000:10000000:2.0:1789584074.331695:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 778: rc = 0 00100000:10000000:2.0:1789584074.332537:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 778: rc = 0 00100000:10000000:2.0:1789584074.333021:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 778: rc = 0 00100000:10000000:2.0:1789584074.333659:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 778: rc = 0 00100000:10000000:2.0:1789584074.334361:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 778: rc = 0 00100000:10000000:2.0:1789584074.334710:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 778: rc = 0 00100000:10000000:2.0:1789584074.335381:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 778: rc = 0 00100000:10000000:2.0:1789584074.335712:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 778: rc = 0 00100000:10000000:2.0:1789584074.336534:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 778: rc = 0 00100000:10000000:2.0:1789584074.337077:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 778: rc = 0 00100000:10000000:2.0:1789584074.337897:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 558: rc = 0 00100000:10000000:2.0:1789584074.338332:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 558: rc = 0 00100000:10000000:2.0:1789584074.338642:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 558: rc = 0 00100000:10000000:2.0:1789584074.339041:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 558: rc = 0 00100000:10000000:2.0:1789584074.339508:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 558: rc = 0 00100000:10000000:2.0:1789584074.339948:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 558: rc = 0 00100000:10000000:2.0:1789584074.340610:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 558: rc = 0 00100000:10000000:2.0:1789584074.341073:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 558: rc = 0 00100000:10000000:2.0:1789584074.341976:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 558: rc = 0 00100000:10000000:2.0:1789584074.343946:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 558: rc = 0 00100000:10000000:2.0:1789584074.346135:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 558: rc = 0 00100000:10000000:3.0:1789584074.353993:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 558: rc = 0 00100000:10000000:3.0:1789584074.354392:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 558: rc = 0 00100000:10000000:3.0:1789584074.354666:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 558: rc = 0 00100000:10000000:3.0:1789584074.358052:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 558: rc = 0 00100000:10000000:3.0:1789584074.358429:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 558: rc = 0 00100000:10000000:3.0:1789584074.359588:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 558: rc = 0 00100000:10000000:3.0:1789584074.361692:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 558: rc = 0 00100000:10000000:3.0:1789584074.363916:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 558: rc = 0 00100000:10000000:3.0:1789584074.366922:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 558: rc = 0 00100000:10000000:3.0:1789584074.368925:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 558: rc = 0 00100000:10000000:3.0:1789584074.370659:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 558: rc = 0 00100000:10000000:3.0:1789584074.372471:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 558: rc = 0 00100000:10000000:3.0:1789584074.373179:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 558: rc = 0 00100000:10000000:3.0:1789584074.375026:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 558: rc = 0 00100000:10000000:3.0:1789584074.375749:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 558: rc = 0 00100000:10000000:3.0:1789584074.376064:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 558: rc = 0 00100000:10000000:3.0:1789584074.376337:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 558: rc = 0 00100000:10000000:3.0:1789584074.376610:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 558: rc = 0 00100000:10000000:3.0:1789584074.376873:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 558: rc = 0 00100000:10000000:3.0:1789584074.377119:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 558: rc = 0 00100000:10000000:2.0:1789584074.378782:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 558: rc = 0 00100000:10000000:2.0:1789584074.379638:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000401:0x1:0x0] under 792: rc = 0 00100000:10000000:2.0:1789584074.380672:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 792: rc = 0 00100000:10000000:2.0:1789584074.383825:0:21927:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789584074.384364:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:2.0:1789584074.385085:0:21927:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789584074.385272:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 773: rc = 0 00100000:10000000:2.0:1789584074.385622:0:21927:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789584074.385686:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00100000:10000000:2.0:1789584074.387306:0:21927:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789584074.387413:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:2.0:1789584074.387617:0:21927:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789584074.387685:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:2.0:1789584074.388266:0:21927:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789584074.388334:0:21927:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00000020:00000080:2.0:1789584074.388611:0:21927:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789584074.388625:0:21927:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789584074.388638:0:21927:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x113b6add9f8691d3 00000020:01000004:2.0:1789584074.388645:0:21927:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789584074.388650:0:21927:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789584074.388655:0:21927:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f8dff997800 from MGS 00000020:01000004:2.0:1789584074.388659:0:21927:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789584074.388670:0:21927:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8f8df768cd40) 00000020:00000080:2.0:1789584074.388683:0:21927:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789584074.388735:0:21927:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8dff997800 from MGS, refs=2 00080000:01000000:2.0:1789584074.388752:0:21927:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789584074.388757:0:21927:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x113b6add9f8691e1 00000100:00100000:2.0:1789584074.389227:0:21927:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789584074.389366:0:21927:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789584074.389385:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789584074.390819:0:21927:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789584074.390896:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789584074.392140:0:21927:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789584074.393004:0:21927:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789584074.393011:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789584074.393995:0:21927:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789584074.394004:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789584074.394606:0:21927:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789584074.394614:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789584074.395947:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584074.395952:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584074.395954:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584074.396952:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584074.396956:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584074.396958:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584074.397670:0:21927:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789584074.405628:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789584074.417431:0:21927:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789584074.417450:0:21927:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789584074.417453:0:21927:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789584074.420314:0:21936:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789584074.420464:0:21927:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789584074.420645:0:21927:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789584074.421405:0:21927:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789584074.422218:0:21927:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789584074.422394:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789584074.422400:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789584074.423083:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789584074.423091:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789584074.423630:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789584074.423637:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789584074.432237:0:21927:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789584074.432261:0:21927:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.111@tcp' 00000020:01000004:0.0:1789584074.432264:0:21927:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789584074.432295:0:21927:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.111@tcp (typ=mgc) 00000020:00000080:0.0:1789584074.432309:0:21927:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.111@tcp (ffff8f8de091b380) 00000020:00000080:0.0:1789584074.432325:0:21927:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789584074.432422:0:21927:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8df74ee000@MGC192.168.204.111@tcp: add connection 192.168.204.111@tcp at head 00010000:00010000:0.0:1789584074.432714:0:21927:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.111@tcp-0 is initialized 00000040:01000000:0.0:1789584074.432721:0:21927:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789584074.433305:0:21941:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789584074.434977:0:21942:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789584074.436650:0:21927:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.111@tcp (uuid aa65f00b-b8fe-4140-826f-6ec0a7b17af3) 00000020:00000080:0.0:1789584074.436684:0:21927:0:(genops.c:1384:class_connect()) connect: client aa65f00b-b8fe-4140-826f-6ec0a7b17af3, cookie 0x113b6add9f8691ef 00000100:00080000:0.0:1789584074.436696:0:21927:0:(import.c:545:import_select_connection()) MGC192.168.204.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789584074.436708:0:21927:0:(import.c:666:import_select_connection()) MGC192.168.204.111@tcp: import ffff8f8df74ee000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1789584074.436754:0:21927:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1a9180 x1876514253821312/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789584074.437613:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3453:1876514253821312:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789584074.437685:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584074.438064:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253821312 00000100:00100000:3.0:1789584074.438073:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253821312 00000100:00100000:3.0:1789584074.438107:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789584074.438114:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3453:x1876514253821312:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789584074.438140:0:21937:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from aa65f00b-b8fe-4140-826f-6ec0a7b17af3@0@lo t0 exp 0000000000000000 cur 727 last 0 00000020:00000080:3.0:1789584074.438171:0:21937:0:(genops.c:1384:class_connect()) connect: client aa65f00b-b8fe-4140-826f-6ec0a7b17af3, cookie 0x113b6add9f8691f6 00000100:00080000:3.0:1789584074.438352:0:21937:0:(import.c:65:import_set_state_nolock()) ffff8f8dc7224800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789584074.442156:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+5:3453:x1876514253821312:12345-0@lo:250:mount.lustre.0 Request processed in 4032us (4462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584074.442171:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789584074.442652:0:3453:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789584074.442664:0:3453:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.111@tcp: connect to target with instance 0 00000100:00080000:0.0:1789584074.442673:0:3453:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789584074.442678:0:3453:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789584074.442683:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8df74ee000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789584074.442685:0:3453:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789584074.442703:0:3453:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789584074.442710:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3453:1876514253821312:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1789584074.444923:0:21927:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import aa65f00b-b8fe-4140-826f-6ec0a7b17af3->MGS 00000020:01000004:0.0:1789584074.444954:0:21927:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789584074.444962:0:21927:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789584074.444977:0:21927:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8f8de0918000) 00000020:00000080:0.0:1789584074.444992:0:21927:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789584074.470944:0:21927:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789584074.471131:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789584074.471138:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789584074.473116:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789584074.473128:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789584074.473785:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789584074.473793:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789584074.475667:0:21927:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789584074.476129:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789584074.476138:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789584074.477012:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789584074.477021:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789584074.526348:0:21927:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789584074.526889:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789584074.526897:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789584074.528160:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789584074.528170:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789584074.529010:0:21927:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789584074.529166:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789584074.529171:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789584074.529728:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789584074.529735:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789584074.531159:0:21927:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789584074.531629:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789584074.531636:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789584074.532518:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789584074.532528:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789584074.533550:0:21927:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789584074.533733:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789584074.533816:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789584074.534932:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789584074.534941:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789584074.567515:0:21927:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789584074.567725:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789584074.567731:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789584074.569952:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789584074.569965:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789584074.570766:0:21927:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789584074.570774:0:21927:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789584074.571681:0:21927:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789584074.571704:0:21927:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789584074.571715:0:21927:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789584074.571866:0:21927:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789584074.571902:0:21927:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.111@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789584074.571907:0:21927:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789584074.571909:0:21927:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789584074.571911:0:21927:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789584074.571913:0:21927:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789584074.571914:0:21927:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789584074.571916:0:21927:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789584074.571917:0:21927:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789584074.571918:0:21927:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789584074.571920:0:21927:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789584074.571921:0:21927:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789584074.571924:0:21927:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789584074.571926:0:21927:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789584074.571927:0:21927:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789584074.571928:0:21927:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789584074.571929:0:21927:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789584074.571930:0:21927:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789584074.571931:0:21927:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789584074.571932:0:21927:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789584074.571933:0:21927:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789584074.571934:0:21927:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789584074.571935:0:21927:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789584074.571962:0:21927:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789584074.571984:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253821440:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789584074.572067:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584074.572102:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8de8665480 going to sleep for 11 seconds 00000100:00100000:0.0:1789584074.573060:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253821440 00000100:00100000:0.0:1789584074.573070:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253821440 00000100:00100000:0.0:1789584074.573121:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789584074.573130:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+5:21927:x1876514253821440:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789584074.573216:0:21939:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789584074.573227:0:21939:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789584074.573230:0:21939:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789584074.573740:0:21961:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789584074.574616:0:21939:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1789584074.578178:0:21962:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789584074.578559:0:21962:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1789584074.578564:0:21962:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789584074.578567:0:21962:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789584074.578700:0:21962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1789584074.579521:0:21939:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789584074.579533:0:21939:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789584074.591082:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+5:21927:x1876514253821440:12345-0@lo:253:mount.lustre.0 Request processed in 17943us (19004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584074.591099:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789584074.591293:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253821440:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789584074.591310:0:21927:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789584074.591313:0:21927:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789584074.591315:0:21927:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789584074.591317:0:21927:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789584074.591318:0:21927:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789584074.591332:0:21927:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789584074.591333:0:21927:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789584074.591335:0:21927:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789584074.591336:0:21927:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789584074.591338:0:21927:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789584074.591339:0:21927:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789584074.591514:0:21927:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f8dff997800 from lustre-MDT0000 10000000:01000000:2.0:1789584074.591543:0:21927:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789584074.591546:0:21927:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789584074.591550:0:21927:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f8de091b380 10000000:01000000:2.0:1789584074.591554:0:21927:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789584074.591561:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f8de091b380 from 1 10000000:01000000:2.0:1789584074.591564:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789584074.591604:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.591615:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.591625:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584074.591645:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253821568:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789584074.591685:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584074.591982:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc1377000 going to sleep for 11 seconds 00000100:00100000:3.0:1789584074.592029:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253821568 00000100:00100000:3.0:1789584074.592036:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253821568 00000100:00100000:3.0:1789584074.592118:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789584074.592128:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+5:21927:x1876514253821568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789584074.592140:0:21937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789584074.592156:0:21937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8df4fe9000/0x113b6add9f86920b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f869204 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.592179:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8df4fe9000/0x113b6add9f86920b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f869204 expref: 6 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.592220:0:21937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8df4fe9000/0x113b6add9f86920b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869204 expref: 6 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.592230:0:21937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8df4fe9000, rc 0) 00000100:00100000:3.0:1789584074.592283:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+6:21927:x1876514253821568:12345-0@lo:101:mount.lustre.0 Request processed in 156us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584074.592290:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789584074.592390:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253821568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789584074.592404:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86920b expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584074.592413:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f86920b expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584074.592476:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253821696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584074.592506:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584074.593303:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253821696 00000100:00100000:2.0:1789584074.593310:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253821696 00000100:00100000:2.0:1789584074.593338:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789584074.593345:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+6:21927:x1876514253821696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789584074.593771:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+6:21927:x1876514253821696:12345-0@lo:501:mount.lustre.0 Request processed in 424us (1263us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789584074.593779:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789584074.594321:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc3f9ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789584074.594346:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253821696:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789584074.594528:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789584074.594554:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86920b expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584074.594565:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86920b expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584074.594574:0:21927:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8dff997800 10000000:01000000:1.0:1789584074.594587:0:21927:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789584074.594591:0:21927:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f8dff997800 10000000:01000000:1.0:1789584074.594594:0:21927:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789584074.594597:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f8dff997800 from 1 10000000:01000000:1.0:1789584074.594600:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789584074.594631:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61000/0x113b6add9f869212 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584074.594639:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61000/0x113b6add9f869212 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584074.594650:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61000/0x113b6add9f869212 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584074.594668:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253821824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789584074.594703:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584074.594726:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc3f9ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789584074.594969:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253821824 00000100:00100000:2.0:1789584074.594976:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253821824 00000100:00100000:2.0:1789584074.595013:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789584074.595021:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+6:21927:x1876514253821824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789584074.595031:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584074.595045:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8cc48c1000/0x113b6add9f869219 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f869212 expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.595066:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8cc48c1000/0x113b6add9f869219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f869212 expref: 7 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.595077:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8cc48c1000/0x113b6add9f869219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869212 expref: 7 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.595085:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8cc48c1000, rc 0) 00000100:00100000:2.0:1789584074.595116:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+7:21927:x1876514253821824:12345-0@lo:101:mount.lustre.0 Request processed in 97us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584074.595123:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789584074.596629:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253821824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789584074.596653:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61000/0x113b6add9f869212 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869219 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584074.596664:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61000/0x113b6add9f869212 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f869219 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584074.596682:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789584074.596701:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61000/0x113b6add9f869212 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869219 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584074.596709:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61000/0x113b6add9f869212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869219 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584074.596736:0:21927:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789584074.596741:0:21927:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789584074.596747:0:21927:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f8dff997800 10000000:01000000:1.0:1789584074.596750:0:21927:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789584074.596754:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789584074.596756:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789584074.596958:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60200/0x113b6add9f869220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584074.596967:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60200/0x113b6add9f869220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584074.596977:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60200/0x113b6add9f869220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584074.596998:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253821952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789584074.597046:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584074.597082:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc3f9ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789584074.597091:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253821952 00000100:00100000:2.0:1789584074.597098:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253821952 00000100:00100000:2.0:1789584074.597179:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789584074.597305:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+7:21927:x1876514253821952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789584074.597320:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584074.597333:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8cc48c1200/0x113b6add9f869227 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f869220 expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.597354:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8cc48c1200/0x113b6add9f869227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f869220 expref: 8 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.597362:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8cc48c1200/0x113b6add9f869227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869220 expref: 8 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.597396:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8cc48c1200, rc 0) 00000100:00100000:2.0:1789584074.597439:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+8:21927:x1876514253821952:12345-0@lo:101:mount.lustre.0 Request processed in 252us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584074.597446:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789584074.597529:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253821952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789584074.597542:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60200/0x113b6add9f869220 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869227 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584074.597549:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60200/0x113b6add9f869220 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f869227 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584074.597595:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253822080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584074.597620:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584074.597643:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc3f9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789584074.597846:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253822080 00000100:00100000:0.0:1789584074.597851:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253822080 00000100:00100000:0.0:1789584074.597886:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789584074.597894:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+8:21927:x1876514253822080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789584074.598346:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+9:21927:x1876514253822080:12345-0@lo:501:mount.lustre.0 Request processed in 452us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584074.598353:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789584074.598489:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253822080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584074.598521:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253822208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789584074.598561:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584074.598623:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc3f9ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789584074.598665:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253822208 00000100:00100000:2.0:1789584074.598670:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253822208 00000100:00100000:2.0:1789584074.598704:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789584074.598711:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+9:21927:x1876514253822208:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789584074.599185:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+9:21927:x1876514253822208:12345-0@lo:503:mount.lustre.0 Request processed in 474us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584074.599223:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789584074.599339:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253822208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789584074.599913:0:21963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21963:1876514253822336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789584074.599958:0:21963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584074.600036:0:21963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8de8665480 going to sleep for 11 seconds 00000100:00100000:0.0:1789584074.600073:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253822336 00000100:00100000:0.0:1789584074.600078:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253822336 00000100:00100000:0.0:1789584074.600147:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789584074.600156:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+9:21963:x1876514253822336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789584074.600480:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+9:21963:x1876514253822336:12345-0@lo:502:llog_process_th.0 Request processed in 325us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584074.600488:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789584074.600577:0:21963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21963:1876514253822336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789584074.600605:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789584074.600616:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.600619:0:21963:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789584074.600624:0:21963:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789584074.600628:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789584074.600642:0:21963:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8f8cc47b3380) 00000020:00000080:1.0:1789584074.600666:0:21963:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789584074.600672:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789584074.600786:0:21963:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789584074.600794:0:21963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x113b6add9f869235 00000020:00000080:1.0:1789584074.601027:0:21963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789584074.601032:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789584074.601050:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.601052:0:21963:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789584074.601057:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789584074.601060:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.601062:0:21963:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789584074.601066:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789584074.601074:0:21963:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8f8cc47b0000) 00000020:00000080:1.0:1789584074.601084:0:21963:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789584074.601088:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789584074.601090:0:21963:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789584074.601099:0:21963:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789584074.601107:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789584074.601154:0:21963:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8dff997800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789584074.601170:0:21963:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8f8cc47b4d40) 00000020:00000080:1.0:1789584074.601180:0:21963:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789584074.601266:0:21963:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789584074.601274:0:21963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x113b6add9f86924a 00000020:00000080:1.0:1789584074.601381:0:21963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789584074.601387:0:21963:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789584074.601392:0:21963:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x113b6add9f869251 00080000:01000000:1.0:1789584074.601397:0:21963:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789584074.601400:0:21963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x113b6add9f869258 00010000:00010000:1.0:1789584074.656866:0:21963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789584074.657589:0:21963:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:0.0:1789584074.657994:0:21963:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789584074.658666:0:21963:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8f8de091cd40) 00000020:00000080:0.0:1789584074.658687:0:21963:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789584074.659928:0:21963:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789584074.659939:0:21963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x113b6add9f869266 00000020:00000080:2.0:1789584074.661315:0:21963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789584074.668272:0:21963:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x113b6add9f86926d 00000020:00000080:1.0:1789584074.669140:0:21963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789584074.669152:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789584074.669158:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.669160:0:21963:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789584074.669163:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789584074.669170:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.669171:0:21963:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789584074.669175:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789584074.669238:0:21963:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789584074.669254:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789584074.669258:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.669259:0:21963:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789584074.669262:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789584074.669263:0:21963:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1789584074.669265:0:21963:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789584074.669267:0:21963:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789584074.669268:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789584074.669270:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.669271:0:21963:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789584074.669273:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789584074.669285:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.669286:0:21963:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789584074.669289:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789584074.669294:0:21963:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:00000080:1.0:1789584074.669321:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789584074.669335:0:21963:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8f8cc477cd40) 00000020:00000080:1.0:1789584074.669348:0:21963:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789584074.669353:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789584074.671669:0:21963:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789584074.671679:0:21963:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789584074.671702:0:21963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x113b6add9f86927b 00010000:00080000:0.0:1789584074.671832:0:21963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8cc4758800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.111@tcp at head 00010000:00010000:0.0:1789584074.680077:0:21963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789584074.683145:0:21963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789584074.683160:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789584074.683230:0:21963:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789584074.683251:0:21963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x113b6add9f869282 00000100:00080000:1.0:1789584074.683262:0:21963:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789584074.683272:0:21963:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f8cc4758800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584074.683309:0:21963:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1af800 x1876514253822464/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789584074.683338:0:21963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1789584074.683481:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789584074.683486:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.683488:0:21963:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789584074.683491:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789584074.683494:0:21963:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1789584074.683496:0:21963:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789584074.683497:0:21963:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789584074.683499:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789584074.683501:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.683502:0:21963:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789584074.683505:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789584074.683510:0:21963:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789584074.683513:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.683515:0:21963:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789584074.683518:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789584074.683528:0:21963:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:01000000:1.0:1789584074.683550:0:21963:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789584074.683552:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789584074.683564:0:21963:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f8cc4778000) 00000020:00000080:1.0:1789584074.683575:0:21963:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789584074.683580:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789584074.683634:0:21963:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789584074.683641:0:21963:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789584074.683647:0:21963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x113b6add9f869290 00010000:00080000:1.0:1789584074.683678:0:21963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8dee199800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.111@tcp at head 00000100:00100000:0.0:1789584074.683877:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253822464:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789584074.683942:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789584074.685561:0:20556:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789584074.685566:0:20556:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789584074.685679:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253822464 00000100:00100000:1.0:1789584074.685689:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253822464 00000100:00100000:1.0:1789584074.685722:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789584074.685731:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3453:x1876514253822464:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1789584074.685750:0:21950:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789584074.685893:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3455:1876514253822592:0@lo:400:kworker.0 00000100:00100000:0.0:1789584074.685950:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584074.686062:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253822592 00000100:00100000:3.0:1789584074.686077:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253822592 00000100:00100000:3.0:1789584074.686116:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789584074.686124:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+9:3455:x1876514253822592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584074.686174:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+9:3455:x1876514253822592:12345-0@lo:400:kworker.0 Request processed in 51us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584074.686180:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789584074.686305:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3455:1876514253822592:0@lo:400:kworker.0 00010000:00010000:0.0:1789584074.689690:0:21963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789584074.691968:0:21963:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789584074.692058:0:21963:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789584074.697017:0:21963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789584074.697088:0:21963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1789584074.697166:0:21963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1789584074.709669:0:21969:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789584074.709680:0:21969:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1789584074.718862:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3453:x1876514253822464:12345-0@lo:38:llog_process_th.0 Request processed in 33124us (34912us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789584074.718879:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789584074.719049:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4758800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584074.719055:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789584074.719059:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253822464:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1789584074.720643:0:21963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789584074.720659:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789584074.720699:0:21963:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789584074.720718:0:21963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x113b6add9f869297 00000100:00080000:0.0:1789584074.720728:0:21963:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789584074.720956:0:21963:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f8dee199800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1789584074.720993:0:21963:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1abb80 x1876514253822720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789584074.721057:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253822720:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789584074.721107:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876514253822720 offset 0 length 520: 4 00000100:00080000:0.0:1789584074.721163:0:21963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789584074.721284:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789584074.721300:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789584074.721302:0:21963:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789584074.721305:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789584074.721308:0:21963:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1789584074.721309:0:21963:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789584074.721311:0:21963:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789584074.721312:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789584074.721315:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789584074.721316:0:21963:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789584074.721319:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789584074.721324:0:21963:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789584074.721327:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789584074.721329:0:21963:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789584074.721331:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789584074.721335:0:21963:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:01000000:0.0:1789584074.721357:0:21963:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789584074.721359:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789584074.721383:0:21963:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f8de09199c0) 00000020:00000080:0.0:1789584074.721395:0:21963:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789584074.721401:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789584074.721458:0:21963:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789584074.721465:0:21963:0:(osd_handler.c:1574:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789584074.721470:0:21963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x113b6add9f8692a5 00010000:00080000:0.0:1789584074.721497:0:21963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8cc3f57000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.111@tcp at head 00010000:00010000:0.0:1789584074.721695:0:21963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789584074.721913:0:21963:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789584074.721935:0:21963:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789584074.722484:0:21963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789584074.722552:0:21963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1789584074.722641:0:21963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00080000:3.0:1789584074.723418:0:20556:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789584074.723425:0:20556:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789584074.723428:0:20556:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4758800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789584074.723435:0:20556:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 727 00000100:00080000:3.0:1789584074.723441:0:20556:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789584074.723453:0:20556:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f8cc4758800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1789584074.723487:0:20556:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dc4c5c700 x1876514253822848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:0.0:1789584074.723746:0:21971:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789584074.723750:0:21971:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789584074.724554:0:21963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789584074.724567:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789584074.724600:0:21963:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789584074.724619:0:21963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x113b6add9f8692ac 00000100:00080000:1.0:1789584074.724630:0:21963:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789584074.724640:0:21963:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f8cc3f57000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584074.724668:0:21963:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1aca80 x1876514253822976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789584074.724853:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253822848:0@lo:38:kworker.0 00000100:00100000:2.0:1789584074.724948:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584074.724982:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253822976:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789584074.725003:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876514253822976 offset 0 length 520: 4 00000100:00100000:2.0:1789584074.725051:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253822848 00000100:00100000:2.0:1789584074.725057:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253822848 00000100:00100000:2.0:1789584074.725098:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789584074.725104:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3453:x1876514253822848:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789584074.725120:0:21951:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789584074.725162:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3453:x1876514253822848:12345-0@lo:38:kworker.0 Request processed in 57us (214us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789584074.725168:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789584074.725220:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4758800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789584074.725225:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789584074.725229:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253822848:0@lo:38:kworker.0 00000100:00080000:1.0:1789584074.725710:0:21963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789584074.725966:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789584074.725982:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.725984:0:21963:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789584074.725988:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789584074.725992:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.725993:0:21963:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789584074.725996:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789584074.725998:0:21963:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789584074.726001:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789584074.726003:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.726004:0:21963:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789584074.726006:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789584074.726008:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.726009:0:21963:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789584074.726012:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789584074.726052:0:21963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21963:1876514253823104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789584074.726106:0:21963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584074.726135:0:21963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789584074.726290:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253823104 00000100:00100000:3.0:1789584074.726296:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253823104 00000100:00100000:3.0:1789584074.726379:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789584074.726388:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+9:21963:x1876514253823104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789584074.726637:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+9:21963:x1876514253823104:12345-0@lo:502:llog_process_th.0 Request processed in 250us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584074.726644:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789584074.726727:0:21963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21963:1876514253823104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789584074.726774:0:21963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789584074.726778:0:21963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584074.726780:0:21963:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789584074.726784:0:21963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789584074.727163:0:21927:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1789584074.727227:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789584074.727243:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60200/0x113b6add9f869220 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869227 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584074.727254:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60200/0x113b6add9f869220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869227 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789584074.727263:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8dff997800 from 1 10000000:01000000:0.0:1789584074.727266:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789584074.727293:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f8692b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584074.727301:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f8692b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584074.727311:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f8692b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584074.727328:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253823232:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789584074.727373:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584074.727713:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dee12bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789584074.727966:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253823232 00000100:00100000:2.0:1789584074.727974:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253823232 00000100:00100000:2.0:1789584074.728004:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789584074.728013:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+9:21927:x1876514253823232:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789584074.728023:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584074.728038:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8cc48c1800/0x113b6add9f8692ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f8692b3 expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.728059:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8cc48c1800/0x113b6add9f8692ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f8692b3 expref: 10 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.728069:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8cc48c1800/0x113b6add9f8692ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8692b3 expref: 10 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.728078:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8cc48c1800, rc 0) 00000100:00100000:2.0:1789584074.728120:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+10:21927:x1876514253823232:12345-0@lo:101:mount.lustre.0 Request processed in 108us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584074.728127:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789584074.728225:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253823232:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789584074.728238:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f8692b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8692ba expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584074.728247:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f8692b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f8692ba expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584074.729401:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253823360:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789584074.729458:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584074.729591:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dee12bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789584074.729724:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253823360 00000100:00100000:1.0:1789584074.729732:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253823360 00000100:00100000:0.0:1789584074.730052:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789584074.730061:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+10:21927:x1876514253823360:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789584074.730078:0:21939:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789584074.730084:0:21939:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789584074.730157:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+10:21927:x1876514253823360:12345-0@lo:256:mount.lustre.0 Request processed in 97us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584074.730165:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789584074.730265:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253823360:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789584074.731172:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789584074.731374:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f8692b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8692ba expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584074.731386:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f8692b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8692ba expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584074.731409:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8dff997800 from 1 10000000:01000000:1.0:1789584074.731412:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789584074.731446:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60800/0x113b6add9f8692c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584074.731455:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60800/0x113b6add9f8692c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584074.731464:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60800/0x113b6add9f8692c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584074.731482:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253823488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789584074.731523:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584074.731553:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789584074.731696:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253823488 00000100:00100000:0.0:1789584074.731703:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253823488 00000100:00100000:0.0:1789584074.732087:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789584074.732097:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+10:21927:x1876514253823488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789584074.732110:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789584074.732127:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8dc0030c00/0x113b6add9f8692c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f8692c1 expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584074.732150:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8dc0030c00/0x113b6add9f8692c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f8692c1 expref: 11 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584074.732160:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8dc0030c00/0x113b6add9f8692c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8692c1 expref: 11 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584074.732168:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8dc0030c00, rc 0) 00000100:00100000:0.0:1789584074.732248:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+11:21927:x1876514253823488:12345-0@lo:101:mount.lustre.0 Request processed in 152us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584074.732254:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789584074.732340:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253823488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789584074.732355:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60800/0x113b6add9f8692c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8692c8 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584074.732376:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60800/0x113b6add9f8692c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f8692c8 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584074.732434:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253823616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584074.732461:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584074.732679:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789584074.732706:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253823616 00000100:00100000:3.0:1789584074.732713:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253823616 00000100:00100000:3.0:1789584074.732739:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789584074.732746:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+11:21927:x1876514253823616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789584074.733531:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+11:21927:x1876514253823616:12345-0@lo:501:mount.lustre.0 Request processed in 783us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584074.733540:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789584074.733751:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253823616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584074.733932:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253823744:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789584074.733984:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584074.734109:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789584074.740044:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253823744 00000100:00100000:0.0:1789584074.740079:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253823744 00000100:00100000:0.0:1789584074.740155:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789584074.740166:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+11:21927:x1876514253823744:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789584074.740446:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+11:21927:x1876514253823744:12345-0@lo:503:mount.lustre.0 Request processed in 282us (6461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584074.740454:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789584074.740780:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253823744:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789584074.741506:0:21973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21973:1876514253823872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789584074.741561:0:21973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584074.741602:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584074.741651:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253823872 00000100:00100000:3.0:1789584074.741657:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253823872 00000100:00100000:3.0:1789584074.741697:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789584074.741706:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+11:21973:x1876514253823872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789584074.742081:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+11:21973:x1876514253823872:12345-0@lo:502:llog_process_th.0 Request processed in 374us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584074.742088:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789584074.742215:0:21973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21973:1876514253823872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789584074.742241:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789584074.742251:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789584074.742253:0:21973:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789584074.742260:0:21973:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8dff997800 00000020:00000080:2.0:1789584074.742263:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789584074.742271:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789584074.742274:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789584074.742275:0:21973:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789584074.742278:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789584074.742280:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789584074.742281:0:21973:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789584074.742285:0:21973:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8dff997800 00000020:00000080:2.0:1789584074.742287:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789584074.742345:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789584074.742348:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789584074.742349:0:21973:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789584074.742352:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789584074.742354:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789584074.742356:0:21973:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789584074.742359:0:21973:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8dff997800 00000020:00000080:2.0:1789584074.742372:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789584074.742391:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789584074.742393:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789584074.742395:0:21973:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789584074.742397:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789584074.742400:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789584074.742401:0:21973:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789584074.742405:0:21973:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8dff997800 00000020:00000080:2.0:1789584074.742407:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789584074.742443:0:21973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21973:1876514253824000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789584074.742480:0:21973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584074.742514:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253824000 00000100:00100000:2.0:1789584074.742518:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253824000 00000100:00100000:2.0:1789584074.742543:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789584074.742550:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+11:21973:x1876514253824000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789584074.742672:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+11:21973:x1876514253824000:12345-0@lo:502:llog_process_th.0 Request processed in 121us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584074.742678:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789584074.742711:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc3eb06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789584074.742722:0:21973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21973:1876514253824000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789584074.742742:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789584074.742746:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789584074.742747:0:21973:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789584074.742750:0:21973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789584074.742817:0:21927:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789584074.742847:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789584074.742863:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60800/0x113b6add9f8692c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8692c8 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.742874:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60800/0x113b6add9f8692c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8692c8 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789584074.742910:0:21927:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789584074.742913:0:21927:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8dff997800 10000000:01000000:2.0:1789584074.742916:0:21927:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8dff997800 10000000:01000000:2.0:1789584074.742921:0:21927:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789584074.742926:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8dff997800 from 1 10000000:01000000:2.0:1789584074.742929:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789584074.742952:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0000/0x113b6add9f8692cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.742971:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0000/0x113b6add9f8692cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.742981:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0000/0x113b6add9f8692cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584074.742994:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253824128:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789584074.743022:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584074.743036:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc3eb0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789584074.743056:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253824128 00000100:00100000:2.0:1789584074.743060:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253824128 00000100:00100000:2.0:1789584074.743081:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789584074.743087:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+11:21927:x1876514253824128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789584074.743095:0:21937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584074.743107:0:21937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8cc48c0a00/0x113b6add9f8692d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f8692cf expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.743128:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8cc48c0a00/0x113b6add9f8692d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f8692cf expref: 12 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.743137:0:21937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8cc48c0a00/0x113b6add9f8692d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8692cf expref: 12 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.743145:0:21937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8cc48c0a00, rc 0) 00000100:00100000:2.0:1789584074.743174:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:21927:x1876514253824128:12345-0@lo:101:mount.lustre.0 Request processed in 87us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584074.743180:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789584074.743241:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253824128:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789584074.743253:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0000/0x113b6add9f8692cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8692d6 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.743262:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0000/0x113b6add9f8692cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f8692d6 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584074.743301:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253824256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789584074.743324:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584074.743337:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc3eb0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789584074.743351:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253824256 00000100:00100000:2.0:1789584074.743354:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253824256 00000100:00100000:2.0:1789584074.743389:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789584074.743395:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:21927:x1876514253824256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789584074.743600:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:21927:x1876514253824256:12345-0@lo:501:mount.lustre.0 Request processed in 201us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584074.743609:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789584074.743644:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253824256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789584074.743668:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253824384:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789584074.743700:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584074.743713:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc3eb0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789584074.743725:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253824384 00000100:00100000:2.0:1789584074.743728:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253824384 00000100:00100000:2.0:1789584074.743748:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789584074.743753:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:21927:x1876514253824384:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789584074.743877:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:21927:x1876514253824384:12345-0@lo:503:mount.lustre.0 Request processed in 123us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584074.743889:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789584074.743926:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253824384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789584074.757887:0:21974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21974:1876514253824512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789584074.757973:0:21974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584074.758022:0:21974:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789584074.760980:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253824512 00000100:00100000:3.0:1789584074.760995:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253824512 00000100:00100000:3.0:1789584074.761057:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789584074.761067:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:21974:x1876514253824512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789584074.763117:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:21974:x1876514253824512:12345-0@lo:502:llog_process_th.0 Request processed in 2043us (5136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584074.763132:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789584074.766935:0:21974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21974:1876514253824512:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789584074.767022:0:21974:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789584074.767039:0:21974:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8f8cc47799c0) 00000020:00000080:1.0:1789584074.767066:0:21974:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1789584074.767160:0:21974:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8dff997800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789584074.767164:0:21974:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8dff997800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789584074.767166:0:21974:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8dff997800 4 00010000:00080000:1.0:1789584074.767227:0:21974:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8dc93a7800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.111@tcp at head 00010000:00010000:1.0:1789584074.768861:0:21974:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1789584074.769040:0:21974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789584074.769072:0:21974:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789584074.769084:0:21974:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x113b6add9f8692e4 00000100:00080000:1.0:1789584074.769094:0:21974:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789584074.769104:0:21974:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f8dc93a7800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584074.769141:0:21974:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1ac380 x1876514253824640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789584074.769214:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876514253824640:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789584074.769289:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789584074.769353:0:21974:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789584074.770308:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253824640 00000100:00100000:0.0:1789584074.770319:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253824640 00000100:00100000:0.0:1789584074.770355:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789584074.770374:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3453:x1876514253824640:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789584074.770445:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3453:x1876514253824640:12345-0@lo:38:llog_process_th.0 Request processed in 82us (1156us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789584074.770451:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789584074.772968:0:21974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21974:1876514253824768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789584074.773049:0:21974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584074.773090:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253824768 00000100:00100000:3.0:1789584074.773097:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253824768 00000100:00100000:3.0:1789584074.773137:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789584074.773146:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:21974:x1876514253824768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789584074.773384:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:21974:x1876514253824768:12345-0@lo:502:llog_process_th.0 Request processed in 239us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584074.773403:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789584074.773504:0:21974:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dfcdf20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584074.773525:0:21974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21974:1876514253824768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789584074.773573:0:21974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21974:1876514253824896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789584074.773606:0:21974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584074.773627:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253824896 00000100:00100000:3.0:1789584074.773631:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253824896 00000100:00100000:3.0:1789584074.773653:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789584074.773660:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:21974:x1876514253824896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789584074.773762:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:21974:x1876514253824896:12345-0@lo:502:llog_process_th.0 Request processed in 102us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584074.773769:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789584074.773796:0:21974:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dfcdf20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584074.773807:0:21974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21974:1876514253824896:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789584074.773825:0:21974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789584074.775963:0:21927:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789584074.776001:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789584074.776027:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0000/0x113b6add9f8692cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8692d6 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.776040:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0000/0x113b6add9f8692cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8692d6 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789584074.776095:0:21927:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789584074.776097:0:21927:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789584074.776099:0:21927:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789584074.776100:0:21927:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789584074.776101:0:21927:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789584074.776103:0:21927:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789584074.776104:0:21927:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789584074.776106:0:21927:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789584074.776107:0:21927:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789584074.776109:0:21927:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789584074.776113:0:21927:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789584074.776115:0:21927:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789584074.776117:0:21927:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789584074.776118:0:21927:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789584074.776119:0:21927:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789584074.776120:0:21927:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789584074.776121:0:21927:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789584074.776122:0:21927:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789584074.776123:0:21927:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789584074.776124:0:21927:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789584074.776125:0:21927:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789584074.776152:0:21927:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789584074.776173:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253825024:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789584074.776296:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584074.776319:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc3eb06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789584074.776587:0:3453:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789584074.776596:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dc93a7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789584074.778971:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789584074.778981:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876514253824640:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789584074.783707:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253825024 00000100:00100000:3.0:1789584074.783720:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253825024 00000100:00100000:3.0:1789584074.783780:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789584074.783791:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:21927:x1876514253825024:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789584074.783822:0:21938:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789584074.783836:0:21938:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789584074.844752:0:21938:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789584074.844807:0:21938:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789584074.846350:0:21961:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789584074.846372:0:21961:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789584074.846478:0:21961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f8692eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.846498:0:21961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8cc48c1800/0x113b6add9f8692ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8692b3 expref: 12 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.846507:0:21961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f8692eb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.846550:0:21961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8cc48c1800/0x113b6add9f8692ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x113b6add9f8692b3 expref: 12 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.846565:0:21961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8cc48c1800/0x113b6add9f8692ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x113b6add9f8692b3 expref: 12 pid: 21938 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584074.846579:0:21961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21961:1876514253825152:0@lo:104: 00000100:00100000:2.0:1789584074.846643:0:21961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584074.846686:0:21961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc2f33a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789584074.846920:0:21928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253825152 00000100:00100000:3.0:1789584074.846928:0:21928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253825152 00000100:00100000:3.0:1789584074.846978:0:21928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789584074.846989:0:21928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+3:21961:x1876514253825152:12345-0@lo:104: 00010000:00010000:3.0:1789584074.847015:0:21928:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f8692b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8692ba expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.847070:0:21928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789584074.847076:0:21928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+3:21961:x1876514253825152:12345-0@lo:104: Request processed in 90us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584074.847083:0:21928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789584074.847111:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789584074.847118:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f8692b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8692ba expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584074.847120:0:21961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21961:1876514253825152:0@lo:104: 00010000:00010000:3.0:1789584074.847139:0:21961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f8692eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.847284:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc0031a00 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:2.0:1789584074.847288:0:21934:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f8692b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x113b6add9f8692ba expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.847298:0:21934:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f8692b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x113b6add9f8692ba expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789584074.847317:0:21934:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f8692b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x113b6add9f8692ba expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789584074.847324:0:21934:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789584074.847374:0:21934:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f8692b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8692ba expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.847381:0:21934:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789584074.847409:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f8692b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8692ba expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.847417:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f8692b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8692ba expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584074.847431:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584074.847433:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584074.847435:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789584074.847454:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789584074.847463:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3457:1876514253825280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789584074.847495:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584074.847573:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253825280 00000100:00100000:3.0:1789584074.847578:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253825280 00010000:00010000:3.0:1789584074.847596:0:21930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8cc48c1800/0x113b6add9f8692ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8692b3 expref: 13 pid: 21938 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584074.847619:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789584074.847626:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+13:3457:x1876514253825280:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789584074.847628:0:21931:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789584074.847635:0:21931:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789584074.847637:0:21930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789584074.847642:0:21930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8cc48c1800/0x113b6add9f8692ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8692b3 expref: 13 pid: 21938 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.847653:0:21930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8cc48c1800/0x113b6add9f8692ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x113b6add9f8692b3 expref: 13 pid: 21938 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.847665:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8cc48c1800/0x113b6add9f8692ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x113b6add9f8692b3 expref: 13 pid: 21938 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.847677:0:21930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f8692eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.847692:0:21930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f8692eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789584074.847704:0:21930:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001346109s 00010000:00010000:3.0:1789584074.847708:0:21930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f8692eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.847715:0:21930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f8692eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.847722:0:21930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f8692eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.847728:0:21930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f8692eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.847733:0:21930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8cc48c1400 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584074.847737:0:21930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f8692eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.847744:0:21930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f8692eb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.847757:0:21930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f8692eb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.847766:0:21930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789584074.848012:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:3457:x1876514253825280:12345-0@lo:103:ldlm_bl.0 Request processed in 385us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584074.848020:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789584074.848053:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3457:1876514253825280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789584074.848071:0:21961:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f8692eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.848078:0:21961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f8692eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584074.848089:0:21961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f8692eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584074.856680:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+11:21927:x1876514253825024:12345-0@lo:253:mount.lustre.0 Request processed in 72882us (80375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584074.856697:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789584074.856923:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21927:1876514253825024:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789584074.856940:0:21927:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789584074.856943:0:21927:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789584074.856944:0:21927:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789584074.856946:0:21927:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789584074.856947:0:21927:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789584074.856948:0:21927:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789584074.856949:0:21927:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789584074.856950:0:21927:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789584074.856952:0:21927:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789584074.856966:0:21927:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789584074.856967:0:21927:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789584074.856983:0:21927:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789584074.864437:0:21927:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789584074.864616:0:21927:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789584074.865140:0:21927:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789584074.865336:0:21927:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789584074.865625:0:21927:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789584074.866368:0:21927:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789584074.869649:0:21927:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789584074.870182:0:21927:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789584074.870505:0:21927:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789584074.871076:0:21927:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789584074.871604:0:21927:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789584074.871874:0:21927:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1789584074.943105:0:21927:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967531 00000040:01000000:0.0:1789584074.943643:0:21927:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1789584074.944137:0:21988:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1789584074.944245:0:21988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789584074.945977:0:21927:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1789584074.946682:0:21989:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8f8dee1ab800 x1876514253825408/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584074.946695:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00000040:01000000:2.0:1789584074.948346:0:21927:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789584074.948490:0:21927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789584074.948910:0:21927:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789584074.948917:0:21927:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789584074.949044:0:21927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789584074.951490:0:21988:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789584074.951571:0:21988:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00080000:1.0:1789584074.951722:0:21987:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967531 00000020:00080000:1.0:1789584074.951727:0:21987:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967531 00000040:00080000:2.0:1789584074.952422:0:21927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789584074.953970:0:21927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789584074.954043:0:21927:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789584074.954619:0:21927:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1789584074.956153:0:21927:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:3.0:1789584074.966996:0:21927:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1789584075.121647:0:21927:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789584075.121685:0:21927:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb71701503988 00100000:10000000:1.0:1789584075.121693:0:21927:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789584075.124110:0:21927:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789584075.124128:0:21927:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789584075.124141:0:21927:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789584075.124172:0:21927:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1789584075.419492:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789584075.805006:0:21981:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789584075.805016:0:21981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789584075.805459:0:21981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789584075.805468:0:21981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789584075.996783:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 10000000:01000000:2.0:1789584076.124655:0:21942:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789584076.124662:0:21942:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8dff997800 from 11 10000000:01000000:2.0:1789584076.124669:0:21942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789584076.124728:0:21942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1e00/0x113b6add9f8692f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584076.124749:0:21942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1e00/0x113b6add9f8692f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584076.124762:0:21942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1e00/0x113b6add9f8692f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584076.124789:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253825536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789584076.124858:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584076.124904:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc133ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789584076.129596:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253825536 00000100:00100000:3.0:1789584076.129634:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253825536 00000100:00100000:3.0:1789584076.129700:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789584076.129721:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+11:21942:x1876514253825536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789584076.129739:0:21939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789584076.129759:0:21939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8df4fe9c00/0x113b6add9f8692f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f8692f2 expref: -99 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584076.129787:0:21939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8df4fe9c00/0x113b6add9f8692f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f8692f2 expref: 12 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584076.129799:0:21939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8df4fe9c00/0x113b6add9f8692f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8692f2 expref: 12 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584076.129808:0:21939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8df4fe9c00, rc 0) 00000100:00100000:3.0:1789584076.129892:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:21942:x1876514253825536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (5033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584076.129899:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789584076.129960:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253825536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789584076.129980:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1e00/0x113b6add9f8692f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8692f9 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584076.129989:0:21942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1e00/0x113b6add9f8692f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f8692f9 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584076.130055:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253825664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789584076.130091:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584076.130119:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc678cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789584076.132050:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253825664 00000100:00100000:0.0:1789584076.132064:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253825664 00000100:00100000:0.0:1789584076.132133:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789584076.132145:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:21942:x1876514253825664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789584076.132205:0:21937:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789584076.132224:0:21937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789584076.132227:0:21937:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1789584076.132373:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:21942:x1876514253825664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 230us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584076.132382:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789584076.132751:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253825664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789584076.132811:0:21942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789584076.132823:0:21942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1e00/0x113b6add9f8692f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8692f9 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584076.132834:0:21942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1e00/0x113b6add9f8692f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8692f9 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584076.445477:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789584076.830934:0:21981:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789584076.830943:0:21981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789584076.838714:0:21981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1789584076.841903:0:21981:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789584076.841955:0:21981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1789584077.020240:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:3.0:1789584077.468424:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584078.043276:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:0.0:1789584078.500728:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584079.067916:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:0.0:1789584079.520994:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584079.836067:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3457:1876514253825792:0@lo:400:kworker.0 00000100:00100000:3.0:1789584079.836158:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789584079.836253:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789584079.836258:0:12001:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789584079.836273:0:12001:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4758800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789584079.836278:0:12001:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 728 00000100:00080000:0.0:1789584079.836283:0:12001:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789584079.836292:0:12001:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f8cc4758800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1789584079.836318:0:12001:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1aad80 x1876514253825920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789584079.836438:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789584079.836443:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789584079.836457:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789584079.836460:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789584079.836477:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789584079.836480:0:12001:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789584079.836482:0:12001:0:(import.c:65:import_set_state_nolock()) ffff8f8dc93a7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789584079.836489:0:12001:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f8dc93a7800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1789584079.836504:0:12001:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1a9f80 x1876514253826048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789584079.847308:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253825920:0@lo:38:kworker.0 00000100:00100000:3.0:1789584079.847391:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584079.847424:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876514253826048:0@lo:38:kworker.0 00000100:00100000:3.0:1789584079.847468:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584079.847896:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253825920 00000100:00100000:2.0:1789584079.847907:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253825920 00000100:00100000:2.0:1789584079.847956:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789584079.847964:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3453:x1876514253825920:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789584079.847984:0:21951:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789584079.848034:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3453:x1876514253825920:12345-0@lo:38:kworker.0 Request processed in 69us (642us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789584079.848041:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789584079.848508:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4758800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789584079.848514:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789584079.848518:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253825920:0@lo:38:kworker.0 00000100:00100000:1.0:1789584079.849039:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253825792 00000100:00100000:1.0:1789584079.849047:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253825792 00000100:00100000:1.0:1789584079.849086:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253826048 00000100:00100000:1.0:1789584079.849090:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253826048 00000100:00100000:1.0:1789584079.849178:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789584079.849185:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3453:x1876514253826048:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789584079.849223:0:21947:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 733 last 0 00000020:00000080:1.0:1789584079.849304:0:21947:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x113b6add9f869300 00000004:00100000:1.0:1789584079.849321:0:21947:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789584079.849499:0:21947:0:(import.c:65:import_set_state_nolock()) ffff8f8dc93a4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789584079.849568:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876514253826048:12345-0@lo:38:kworker.0 Request processed in 382us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584079.849893:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789584079.850234:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f8dee1a9f80 x1876514253826048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789584089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789584079.850252:0:3453:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789584079.850260:0:3453:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789584079.850278:0:3453:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789584079.850281:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dc93a7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789584079.850286:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876514253826048:0@lo:38:kworker.0 00000100:00100000:1.0:1789584079.850942:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789584079.850952:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:3457:x1876514253825792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584079.851042:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:3457:x1876514253825792:12345-0@lo:400:kworker.0 Request processed in 91us (14883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584079.851049:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789584079.851375:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3457:1876514253825792:0@lo:400:kworker.0 00000100:00100000:1.0:1789584080.091586:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:1.0:1789584080.544952:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789584080.555000:0:22232:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789584081.116403:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:0.0:1789584081.571696:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584082.139659:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:1.0:1789584082.591865:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584083.163327:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:3.0:1789584083.612684:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789584084.193598:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:1.0:1789584084.636405:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584084.956573:0:3453:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789584074/real 1789584074] req@ffff8f8dee1aca80 x1876514253822976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584084 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584084.956603:0:3453:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8dee1aca80 x1876514253822976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584084 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584084.956614:0:3453:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789584074/real 1789584074] req@ffff8f8dee1abb80 x1876514253822720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584084 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584084.956637:0:3453:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8dee1abb80 x1876514253822720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584084 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789584084.956656:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc3f57000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789584084.963722:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789584084.963734:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253822976:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789584084.963747:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dee199800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789584084.968134:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789584084.968141:0:12001:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789584084.968145:0:12001:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4758800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789584084.968154:0:12001:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 733 00000100:00080000:2.0:1789584084.968159:0:12001:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789584084.968181:0:12001:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f8cc4758800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1789584084.968220:0:12001:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8df7819880 x1876514253826304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789584084.968233:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584084.968237:0:12001:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789584084.968238:0:12001:0:(import.c:65:import_set_state_nolock()) ffff8f8dee199800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789584084.968242:0:12001:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 728 00000100:00080000:2.0:1789584084.968244:0:12001:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789584084.968249:0:12001:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f8dee199800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1789584084.968262:0:12001:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8df781b480 x1876514253826432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789584084.968293:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584084.968296:0:12001:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789584084.968298:0:12001:0:(import.c:65:import_set_state_nolock()) ffff8f8cc3f57000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789584084.968301:0:12001:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 728 00000100:00080000:2.0:1789584084.968304:0:12001:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789584084.968308:0:12001:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f8cc3f57000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1789584084.968319:0:12001:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8df781bb80 x1876514253826560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789584084.968359:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253826176:0@lo:400:kworker.0 00000100:00100000:2.0:1789584084.968428:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584084.968487:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789584084.968492:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3454:1876514253826688:0@lo:400:kworker.0 00000100:00100000:2.0:1789584084.968522:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584084.972720:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253826176 00000100:00100000:2.0:1789584084.972737:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253826176 00000100:00100000:2.0:1789584084.972802:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789584084.972810:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:3454:x1876514253826176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584084.972895:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:3454:x1876514253826176:12345-0@lo:400:kworker.0 Request processed in 85us (4466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584084.972901:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789584084.972964:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253826176:0@lo:400:kworker.0 00000100:00080000:3.0:1789584084.977682:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789584084.977756:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253822720:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789584084.977801:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253826304:0@lo:38:kworker.0 00000100:00100000:3.0:1789584084.977938:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584084.977987:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253826304 00000100:00100000:3.0:1789584084.977994:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253826304 00000100:00100000:3.0:1789584084.978025:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789584084.978033:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3453:x1876514253826304:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789584084.978055:0:21951:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789584084.978090:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3453:x1876514253826304:12345-0@lo:38:kworker.0 Request processed in 56us (151us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789584084.978112:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789584084.978154:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4758800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789584084.978158:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789584084.978177:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253826304:0@lo:38:kworker.0 00000100:00100000:3.0:1789584084.978185:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253826432:0@lo:8:kworker.0 00000400:00000100:3.0:1789584084.978227:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876514253826432 offset 0 length 520: 4 00000100:00100000:3.0:1789584084.978259:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253826560:0@lo:8:kworker.0 00000400:00000100:3.0:1789584084.978277:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876514253826560 offset 0 length 520: 4 00000100:00100000:3.0:1789584084.978362:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253826688 00000100:00100000:3.0:1789584084.978368:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253826688 00000100:00100000:3.0:1789584084.978468:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789584084.978478:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3454:x1876514253826688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584084.978535:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3454:x1876514253826688:12345-0@lo:400:kworker.0 Request processed in 59us (10010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584084.978542:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789584084.980659:0:3454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f8df781aa00 x1876514253826688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584084.980680:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3454:1876514253826688:0@lo:400:kworker.0 00000100:00100000:0.0:1789584085.212975:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:1.0:1789584085.660220:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789584086.046854:0:21981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789584086.236345:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:1.0:1789584086.685633:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789584087.262931:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:3.0:1789584087.710526:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584088.285826:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:3.0:1789584088.736043:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789584088.926307:0:22582:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789584088.926311:0:22582:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt2/mdt2 00000080:01200004:2.0:1789584088.926418:0:22582:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f8def4be000 00000020:01000004:2.0:1789584088.926440:0:22582:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-zfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789584088.926451:0:22582:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789584088.926465:0:22582:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8f8df76899c0) 00000020:00000080:2.0:1789584088.926480:0:22582:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789584088.945392:0:22582:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789584088.948653:0:22582:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789584088.951680:0:22582:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000003:0x30:0x0] (8/32) 00100000:10000000:2.0:1789584088.952022:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-client under 293: rc = 0 00100000:10000000:2.0:1789584088.952176:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled params under 293: rc = 0 00100000:10000000:2.0:1789584088.952312:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-MDT0001 under 293: rc = 0 00100000:10000000:2.0:1789584088.955045:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000 under 558: rc = 0 00100000:10000000:2.0:1789584088.956520:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000 under 558: rc = 0 00100000:10000000:2.0:1789584088.957100:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000-MDT0001 under 558: rc = 0 00100000:10000000:2.0:1789584088.958748:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000-MDT0001 under 558: rc = 0 00100000:10000000:2.0:1789584088.959035:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000-MDT0001 under 558: rc = 0 00100000:10000000:2.0:1789584088.961029:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000 under 558: rc = 0 00100000:10000000:2.0:1789584088.964596:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000 under 558: rc = 0 00100000:10000000:2.0:1789584088.966510:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000-MDT0001 under 558: rc = 0 00100000:10000000:2.0:1789584088.967028:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000 under 558: rc = 0 00100000:10000000:2.0:1789584088.967387:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000-MDT0001 under 558: rc = 0 00100000:10000000:2.0:1789584088.967944:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000-MDT0001 under 558: rc = 0 00100000:10000000:2.0:1789584088.968239:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000 under 558: rc = 0 00100000:10000000:3.0:1789584088.970223:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_06 under 501: rc = 0 00100000:10000000:3.0:1789584088.971880:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_07 under 501: rc = 0 00100000:10000000:3.0:1789584088.972165:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_14 under 501: rc = 0 00100000:10000000:3.0:1789584088.973879:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_15 under 501: rc = 0 00100000:10000000:3.0:1789584088.974168:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_13 under 501: rc = 0 00100000:10000000:3.0:1789584088.974449:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_12 under 501: rc = 0 00100000:10000000:3.0:1789584088.977061:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_01 under 501: rc = 0 00100000:10000000:3.0:1789584088.977986:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_00 under 501: rc = 0 00100000:10000000:3.0:1789584088.979367:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_04 under 501: rc = 0 00100000:10000000:3.0:1789584088.979850:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_05 under 501: rc = 0 00100000:10000000:3.0:1789584088.980104:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_11 under 501: rc = 0 00100000:10000000:3.0:1789584088.981539:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_10 under 501: rc = 0 00100000:10000000:3.0:1789584088.983067:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_08 under 501: rc = 0 00100000:10000000:3.0:1789584088.984882:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_03 under 501: rc = 0 00100000:10000000:3.0:1789584088.985179:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_02 under 501: rc = 0 00100000:10000000:3.0:1789584088.987496:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_09 under 501: rc = 0 00100000:10000000:3.0:1789584088.991078:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_01 under 501: rc = 0 00100000:10000000:3.0:1789584088.991404:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_00 under 501: rc = 0 00100000:10000000:3.0:1789584088.992352:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_13 under 501: rc = 0 00100000:10000000:3.0:1789584088.993500:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_12 under 501: rc = 0 00100000:10000000:3.0:1789584088.993785:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_14 under 501: rc = 0 00100000:10000000:3.0:1789584088.994027:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_15 under 501: rc = 0 00100000:10000000:3.0:1789584088.994330:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_06 under 501: rc = 0 00100000:10000000:3.0:1789584088.994589:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_07 under 501: rc = 0 00100000:10000000:3.0:1789584088.994830:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_03 under 501: rc = 0 00100000:10000000:3.0:1789584088.995076:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_08 under 501: rc = 0 00100000:10000000:3.0:1789584088.995353:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_09 under 501: rc = 0 00100000:10000000:3.0:1789584088.997134:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_02 under 501: rc = 0 00100000:10000000:3.0:1789584088.997408:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_11 under 501: rc = 0 00100000:10000000:3.0:1789584088.997790:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_10 under 501: rc = 0 00100000:10000000:3.0:1789584088.998393:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_04 under 501: rc = 0 00100000:10000000:3.0:1789584088.998790:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_05 under 501: rc = 0 00100000:10000000:3.0:1789584088.999139:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000401:0x1:0x0] under 572: rc = 0 00100000:10000000:3.0:1789584088.999349:0:22582:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000400:0x1:0x0] under 572: rc = 0 00000020:00000080:2.0:1789584089.000881:0:22582:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789584089.000895:0:22582:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789584089.000905:0:22582:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x113b6add9f86930e 00000020:01000004:2.0:1789584089.000913:0:22582:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device lustre-mdt2/mdt2 00000020:01000004:2.0:1789584089.000934:0:22582:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789584089.000938:0:22582:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789584089.000950:0:22582:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789584089.000970:0:22582:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt2/mdt2 10000000:01000000:2.0:1789584089.000974:0:22582:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1789584089.011916:0:22582:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789584089.011956:0:22582:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.111@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1789584089.011961:0:22582:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789584089.011964:0:22582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789584089.011965:0:22582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789584089.011967:0:22582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789584089.011968:0:22582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789584089.011970:0:22582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789584089.011971:0:22582:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789584089.011972:0:22582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789584089.011974:0:22582:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789584089.011978:0:22582:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1789584089.011980:0:22582:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789584089.011986:0:22582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789584089.011988:0:22582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789584089.011989:0:22582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789584089.011990:0:22582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789584089.011991:0:22582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789584089.011991:0:22582:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789584089.011992:0:22582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789584089.011993:0:22582:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789584089.012022:0:22582:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789584089.012044:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253826816:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789584089.012127:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.012256:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc5daa540 going to sleep for 11 seconds 00000100:00100000:3.0:1789584089.012366:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253826816 00000100:00100000:3.0:1789584089.012375:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253826816 00000100:00100000:1.0:1789584089.012557:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789584089.012566:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:22582:x1876514253826816:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789584089.012727:0:21938:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789584089.012731:0:21938:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1789584089.012738:0:21938:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789584089.020448:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:22582:x1876514253826816:12345-0@lo:253:mount.lustre.0 Request processed in 7874us (8312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584089.020463:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789584089.020664:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253826816:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789584089.020679:0:22582:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789584089.020682:0:22582:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789584089.020683:0:22582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789584089.020685:0:22582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789584089.020686:0:22582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789584089.020687:0:22582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789584089.020688:0:22582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789584089.020689:0:22582:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789584089.020691:0:22582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789584089.020692:0:22582:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789584089.020709:0:22582:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f8def4be000 from lustre-MDT0001 10000000:01000000:1.0:1789584089.020732:0:22582:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789584089.020735:0:22582:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789584089.020741:0:22582:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f8de091b380 local copy 00010000:00010000:1.0:1789584089.020752:0:22582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86920b expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584089.020969:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253826944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584089.021001:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.021079:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc5daa540 going to sleep for 11 seconds 00000100:00100000:3.0:1789584089.021181:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253826944 00000100:00100000:3.0:1789584089.021203:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253826944 00000100:00100000:3.0:1789584089.021276:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789584089.021286:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:22582:x1876514253826944:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789584089.021432:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:22582:x1876514253826944:12345-0@lo:501:mount.lustre.0 Request processed in 148us (430us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789584089.021438:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789584089.021498:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253826944:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789584089.021509:0:22582:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789584089.021665:0:22582:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789584089.021672:0:22582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86920b expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.021681:0:22582:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86920b expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584089.021700:0:22582:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8def4be000 10000000:01000000:1.0:1789584089.021704:0:22582:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789584089.021708:0:22582:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f8de091b380 10000000:01000000:1.0:1789584089.021711:0:22582:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789584089.021714:0:22582:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8f8de091b380 from 1 10000000:01000000:1.0:1789584089.021717:0:22582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789584089.021738:0:22582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60c00/0x113b6add9f869315 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.021746:0:22582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60c00/0x113b6add9f869315 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.021755:0:22582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60c00/0x113b6add9f869315 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584089.021777:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253827072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789584089.021801:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.022010:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc5daa540 going to sleep for 11 seconds 00000100:00100000:2.0:1789584089.022107:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253827072 00000100:00100000:2.0:1789584089.022112:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253827072 00000100:00100000:2.0:1789584089.022137:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789584089.022144:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+12:22582:x1876514253827072:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789584089.022151:0:21939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584089.022164:0:21939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8cc48c1a00/0x113b6add9f86931c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f869315 expref: -99 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584089.022184:0:21939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8cc48c1a00/0x113b6add9f86931c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f869315 expref: 13 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584089.022212:0:21939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8cc48c1a00/0x113b6add9f86931c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869315 expref: 13 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584089.022220:0:21939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8cc48c1a00, rc 0) 00000100:00100000:2.0:1789584089.022258:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+13:22582:x1876514253827072:12345-0@lo:101:mount.lustre.0 Request processed in 116us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584089.022264:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789584089.022344:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253827072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789584089.022355:0:22582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60c00/0x113b6add9f869315 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86931c expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.022364:0:22582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60c00/0x113b6add9f869315 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f86931c expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584089.022379:0:22582:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789584089.022400:0:22582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60c00/0x113b6add9f869315 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86931c expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.022408:0:22582:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60c00/0x113b6add9f869315 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86931c expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584089.022415:0:22582:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f8def4be000 10000000:01000000:1.0:1789584089.022419:0:22582:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789584089.022422:0:22582:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f8def4be000 from 1 10000000:01000000:1.0:1789584089.022424:0:22582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789584089.022440:0:22582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61a00/0x113b6add9f869323 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.022447:0:22582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61a00/0x113b6add9f869323 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.022453:0:22582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61a00/0x113b6add9f869323 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584089.022473:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253827200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789584089.022499:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.022515:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc5daa540 going to sleep for 11 seconds 00000100:00100000:2.0:1789584089.022681:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253827200 00000100:00100000:2.0:1789584089.022686:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253827200 00000100:00100000:2.0:1789584089.022705:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789584089.022712:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dda102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+13:22582:x1876514253827200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789584089.022719:0:21939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584089.022727:0:21939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8cc48c0e00/0x113b6add9f86932a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f869323 expref: -99 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584089.022755:0:21939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8cc48c0e00/0x113b6add9f86932a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f869323 expref: 14 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584089.022763:0:21939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8cc48c0e00/0x113b6add9f86932a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869323 expref: 14 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584089.022770:0:21939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8cc48c0e00, rc 0) 00000100:00100000:2.0:1789584089.022810:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dda102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+14:22582:x1876514253827200:12345-0@lo:101:mount.lustre.0 Request processed in 95us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584089.022816:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789584089.022890:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253827200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789584089.022900:0:22582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61a00/0x113b6add9f869323 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86932a expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.022907:0:22582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61a00/0x113b6add9f869323 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f86932a expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584089.022916:0:22582:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789584089.022929:0:22582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61a00/0x113b6add9f869323 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86932a expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.022935:0:22582:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61a00/0x113b6add9f869323 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86932a expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584089.022941:0:22582:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789584089.022944:0:22582:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789584089.022949:0:22582:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f8def4be000 10000000:01000000:1.0:1789584089.022952:0:22582:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789584089.022954:0:22582:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789584089.022956:0:22582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789584089.022969:0:22582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61200/0x113b6add9f869331 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.022976:0:22582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61200/0x113b6add9f869331 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.022990:0:22582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61200/0x113b6add9f869331 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584089.023003:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253827328:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789584089.023027:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.023039:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc5daa540 going to sleep for 11 seconds 00000100:00100000:2.0:1789584089.023105:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253827328 00000100:00100000:2.0:1789584089.023109:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253827328 00000100:00100000:2.0:1789584089.023126:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789584089.023133:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+14:22582:x1876514253827328:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789584089.023139:0:21939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584089.023147:0:21939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8cc48c1c00/0x113b6add9f869338 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f869331 expref: -99 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584089.023161:0:21939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8cc48c1c00/0x113b6add9f869338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f869331 expref: 15 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584089.023167:0:21939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8cc48c1c00/0x113b6add9f869338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869331 expref: 15 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584089.023173:0:21939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8cc48c1c00, rc 0) 00000100:00100000:2.0:1789584089.023228:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+15:22582:x1876514253827328:12345-0@lo:101:mount.lustre.0 Request processed in 95us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584089.023235:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789584089.023317:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253827328:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789584089.023327:0:22582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61200/0x113b6add9f869331 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869338 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.023334:0:22582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61200/0x113b6add9f869331 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f869338 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789584089.024257:0:22582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1789584089.025489:0:22582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789584089.025888:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1789584089.025933:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1789584089.025984:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1789584089.026023:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1789584089.026060:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1789584089.026123:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1789584089.026161:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1789584089.026227:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1789584089.026279:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1789584089.026318:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1789584089.026353:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1789584089.026403:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1789584089.026438:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1789584089.026470:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1789584089.026726:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1789584089.026770:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1789584089.026805:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 160 off11176 00000040:00080000:1.0:1789584089.026931:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11400 00000040:00080000:1.0:1789584089.026971:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11624 00000040:00080000:1.0:1789584089.029069:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 80 off11704 00000040:00080000:1.0:1789584089.029384:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1789584089.029428:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1789584089.029463:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1789584089.029513:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1789584089.029830:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1789584089.029988:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1789584089.030039:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1789584089.030072:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1789584089.030119:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1789584089.030167:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1789584089.034255:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1789584089.034331:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1789584089.034408:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1789584089.034472:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1789584089.034513:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1789584089.034704:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1789584089.034746:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1789584089.034781:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1789584089.034829:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1789584089.034945:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1789584089.034983:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1789584089.035033:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1789584089.035070:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1789584089.036077:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1789584089.036652:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1789584089.036661:0:22582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1789584089.036757:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253827456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584089.036830:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.036992:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc5daa780 going to sleep for 11 seconds 00000100:00100000:2.0:1789584089.037070:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253827456 00000100:00100000:2.0:1789584089.037078:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253827456 00000100:00100000:2.0:1789584089.037140:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789584089.037150:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+15:22582:x1876514253827456:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789584089.037540:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+15:22582:x1876514253827456:12345-0@lo:501:mount.lustre.0 Request processed in 390us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584089.037549:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789584089.037835:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253827456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584089.037948:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253827584:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789584089.037989:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.038009:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc5daa780 going to sleep for 11 seconds 00000100:00100000:3.0:1789584089.038121:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253827584 00000100:00100000:3.0:1789584089.038127:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253827584 00000100:00100000:3.0:1789584089.038162:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789584089.038170:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+15:22582:x1876514253827584:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789584089.038502:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+15:22582:x1876514253827584:12345-0@lo:503:mount.lustre.0 Request processed in 331us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584089.038509:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789584089.038806:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253827584:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789584089.039434:0:22582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789584089.039502:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253827712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584089.039567:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584089.039686:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253827712 00000100:00100000:0.0:1789584089.039693:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253827712 00000100:00100000:0.0:1789584089.039732:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789584089.039741:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+15:22582:x1876514253827712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789584089.043156:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+15:22582:x1876514253827712:12345-0@lo:502:mount.lustre.0 Request processed in 3407us (3579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584089.043173:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789584089.043320:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8de0924f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789584089.043347:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253827712:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789584089.043781:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1789584089.043936:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1789584089.043997:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1789584089.044034:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1789584089.044067:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1789584089.044129:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1789584089.044169:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1789584089.044264:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1789584089.044320:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1789584089.044358:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1789584089.044389:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1789584089.044433:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1789584089.044468:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1789584089.044499:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1789584089.044694:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1789584089.044744:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1789584089.044778:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 160 off11176 00000040:00080000:1.0:1789584089.044845:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11400 00000040:00080000:1.0:1789584089.044951:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11624 00000040:00080000:1.0:1789584089.044986:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 80 off11704 00000040:00080000:1.0:1789584089.045036:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1789584089.045073:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1789584089.045123:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1789584089.045172:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1789584089.045318:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1789584089.045347:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1789584089.045388:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1789584089.045418:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1789584089.045445:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1789584089.045488:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1789584089.045521:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1789584089.045685:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1789584089.045735:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1789584089.045783:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1789584089.045810:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1789584089.045961:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1789584089.046000:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1789584089.046028:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1789584089.046076:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1789584089.046128:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1789584089.046161:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1789584089.046306:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1789584089.046341:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1789584089.046369:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1789584089.046416:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253827840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584089.046490:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.046680:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc5daa780 going to sleep for 11 seconds 00000100:00100000:3.0:1789584089.046917:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253827840 00000100:00100000:3.0:1789584089.046926:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253827840 00000100:00100000:3.0:1789584089.047013:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789584089.047023:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+15:22582:x1876514253827840:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789584089.047300:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+15:22582:x1876514253827840:12345-0@lo:502:mount.lustre.0 Request processed in 278us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584089.047316:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789584089.047410:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253827840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789584089.047516:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1789584089.047528:0:22582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1789584089.049731:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789584089.049744:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789584089.049746:0:22583:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789584089.049751:0:22583:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789584089.049754:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789584089.049768:0:22583:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8f8df7688000) 00000020:00000080:2.0:1789584089.049788:0:22583:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1789584089.049792:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789584089.049961:0:22583:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789584089.049969:0:22583:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x113b6add9f869346 00000020:00000080:2.0:1789584089.050295:0:22583:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789584089.050300:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789584089.050304:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789584089.050306:0:22583:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789584089.050308:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789584089.050312:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789584089.050314:0:22583:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789584089.050317:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789584089.050325:0:22583:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8f8df768b380) 00000020:00000080:2.0:1789584089.050337:0:22583:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1789584089.050347:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789584089.050349:0:22583:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789584089.050352:0:22583:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789584089.050357:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789584089.050402:0:22583:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8def4be000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789584089.050422:0:22583:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8f8de80719c0) 00000020:00000080:2.0:1789584089.050433:0:22583:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1789584089.050486:0:22583:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789584089.050491:0:22583:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x113b6add9f86935b 00000020:00000080:2.0:1789584089.050758:0:22583:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789584089.050765:0:22583:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789584089.050771:0:22583:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x113b6add9f869362 00080000:01000000:2.0:1789584089.050777:0:22583:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789584089.050781:0:22583:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x113b6add9f869369 00010000:00010000:3.0:1789584089.142769:0:22583:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1789584089.143231:0:22583:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1789584089.143394:0:22583:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789584089.153402:0:22583:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789584089.153416:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789584089.153425:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789584089.153427:0:22583:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789584089.153447:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789584089.153454:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789584089.153456:0:22583:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789584089.153459:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789584089.153465:0:22583:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:00000080:0.0:1789584089.153491:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789584089.153509:0:22583:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8f8e009d3380) 00000020:00000080:0.0:1789584089.153532:0:22583:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1789584089.153538:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789584089.153786:0:22583:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789584089.153795:0:22583:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789584089.153802:0:22583:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x113b6add9f869377 00010000:00080000:0.0:1789584089.153833:0:22583:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8dc7225000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.111@tcp at head 00010000:00010000:0.0:1789584089.170953:0:22583:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1789584089.175354:0:22583:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789584089.175370:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789584089.175409:0:22583:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789584089.175434:0:22583:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x113b6add9f86937e 00000100:00080000:3.0:1789584089.175445:0:22583:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789584089.175457:0:22583:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f8dc7225000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1789584089.175493:0:22583:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dc4c5ed80 x1876514253827968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789584089.175516:0:22583:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789584089.175691:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789584089.175698:0:12001:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789584089.175701:0:12001:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4758800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789584089.175705:0:12001:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 738 00000100:00080000:1.0:1789584089.175708:0:12001:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789584089.175713:0:12001:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f8cc4758800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584089.175730:0:12001:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1ace00 x1876514253828096/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789584089.175740:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789584089.175743:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789584089.175745:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789584089.175748:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789584089.175789:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876514253828224:0@lo:400:kworker.0 00000100:00100000:1.0:1789584089.175851:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.175903:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253828224 00000100:00100000:1.0:1789584089.175911:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253828224 00000100:00100000:1.0:1789584089.175956:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789584089.175965:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876514253828224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584089.176013:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876514253828224:12345-0@lo:400:kworker.0 Request processed in 49us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584089.176019:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789584089.176055:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f8dee1adc00 x1876514253828224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584089.176067:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876514253828224:0@lo:400:kworker.0 00000100:00100000:0.0:1789584089.176238:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253827968:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789584089.176272:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584089.176301:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253828096:0@lo:38:kworker.0 00000100:00100000:0.0:1789584089.176319:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584089.176432:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253827968 00000100:00100000:0.0:1789584089.176436:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253827968 00000100:00100000:0.0:1789584089.176450:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253828096 00000100:00100000:0.0:1789584089.176453:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253828096 00000100:00100000:0.0:1789584089.176461:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789584089.176466:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3453:x1876514253827968:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789584089.176487:0:21950:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 742 last 0 00000020:00000080:0.0:1789584089.176521:0:21950:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x113b6add9f869385 00000004:00100000:0.0:1789584089.176535:0:21950:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789584089.176551:0:21950:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:3.0:1789584089.176967:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789584089.176977:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584089.176979:0:22583:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789584089.176984:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789584089.176989:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584089.176991:0:22583:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789584089.176995:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789584089.177039:0:22583:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789584089.177058:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789584089.177061:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584089.177063:0:22583:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789584089.177065:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789584089.177067:0:22583:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1789584089.177069:0:22583:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789584089.177070:0:22583:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789584089.177072:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789584089.177093:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584089.177095:0:22583:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789584089.177099:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789584089.177101:0:22583:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1789584089.177102:0:22583:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789584089.177104:0:22583:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789584089.177105:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789584089.177108:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584089.177110:0:22583:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789584089.177112:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789584089.177116:0:22583:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt2/mdt2 00000020:00000080:3.0:1789584089.177119:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584089.177120:0:22583:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789584089.177123:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789584089.177128:0:22583:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:01000000:3.0:1789584089.177148:0:22583:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789584089.177151:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789584089.177164:0:22583:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8f8cc5cc99c0) 00000020:00000080:3.0:1789584089.177177:0:22583:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789584089.177182:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789584089.177274:0:22583:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789584089.177280:0:22583:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789584089.177287:0:22583:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x113b6add9f869393 00010000:00080000:3.0:1789584089.177327:0:22583:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8dd1dbb000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.111@tcp at head 00010000:00010000:3.0:1789584089.177535:0:22583:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1789584089.182832:0:22583:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789584089.182908:0:22583:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789584089.187726:0:22583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789584089.187808:0:22583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1789584089.187880:0:22583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1789584089.188724:0:22589:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789584089.188729:0:22589:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789584089.189462:0:22583:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789584089.189474:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789584089.189508:0:22583:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789584089.189528:0:22583:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x113b6add9f86939a 00000100:00080000:1.0:1789584089.189538:0:22583:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789584089.189566:0:22583:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f8dd1dbb000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584089.189623:0:22583:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1adc00 x1876514253828352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789584089.189647:0:22583:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789584089.189698:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789584089.189702:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584089.189704:0:22583:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789584089.189707:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789584089.189709:0:22583:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789584089.189711:0:22583:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789584089.189713:0:22583:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789584089.189714:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789584089.189716:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584089.189717:0:22583:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789584089.189720:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789584089.189724:0:22583:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt2/mdt2 00000020:00000080:1.0:1789584089.189727:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584089.189728:0:22583:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789584089.189730:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789584089.189734:0:22583:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:01000000:1.0:1789584089.189754:0:22583:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789584089.189756:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789584089.189768:0:22583:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8f8cc477b380) 00000020:00000080:1.0:1789584089.189781:0:22583:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789584089.189786:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789584089.189848:0:22583:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789584089.189855:0:22583:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789584089.189862:0:22583:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x113b6add9f8693a8 00010000:00080000:1.0:1789584089.189890:0:22583:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8dc93a0800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.111@tcp at head 00010000:00010000:1.0:1789584089.190074:0:22583:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789584089.190274:0:22583:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789584089.190296:0:22583:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789584089.190715:0:22583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789584089.190780:0:22583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1789584089.190848:0:22583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000100:00100000:0.0:1789584089.191154:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253828352:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789584089.191234:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876514253828352 offset 0 length 520: 4 00000100:00080000:3.0:1789584089.191486:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789584089.191498:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789584089.191501:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789584089.191504:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1789584089.192049:0:22591:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789584089.192055:0:22591:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789584089.192888:0:22583:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789584089.192899:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789584089.192943:0:22583:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789584089.192963:0:22583:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x113b6add9f8693af 00000100:00080000:0.0:1789584089.192973:0:22583:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789584089.192982:0:22583:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f8dc93a0800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1789584089.193013:0:22583:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1aa680 x1876514253828480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789584089.193043:0:22583:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789584089.193101:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789584089.193106:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789584089.193108:0:22583:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789584089.193111:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789584089.193114:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789584089.193116:0:22583:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789584089.193118:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789584089.193120:0:22583:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789584089.193122:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789584089.193124:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789584089.193125:0:22583:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789584089.193127:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789584089.193130:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789584089.193131:0:22583:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789584089.193134:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789584089.193338:0:22583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789584089.193342:0:22583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789584089.193344:0:22583:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789584089.193347:0:22583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:0.0:1789584089.193406:0:22582:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789584089.193431:0:22582:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789584089.193447:0:22582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61200/0x113b6add9f869331 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869338 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584089.193458:0:22582:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61200/0x113b6add9f869331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869338 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789584089.193466:0:22582:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8def4be000 from 1 10000000:01000000:0.0:1789584089.193469:0:22582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789584089.193493:0:22582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8693b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584089.193501:0:22582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8693b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584089.193512:0:22582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8693b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584089.193529:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253828608:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789584089.193717:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253828480:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789584089.193767:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876514253828480 offset 0 length 520: 4 00000100:00100000:0.0:1789584089.193869:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789584089.193954:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789584089.193958:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789584089.193961:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789584089.193964:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789584089.194015:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc678c300 going to sleep for 11 seconds 00000100:00100000:1.0:1789584089.203971:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253828608 00000100:00100000:1.0:1789584089.203987:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253828608 00000100:00100000:1.0:1789584089.204054:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789584089.204065:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+15:22582:x1876514253828608:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789584089.204092:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584089.204115:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8dc4c60e00/0x113b6add9f8693bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f8693b6 expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.204140:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8dc4c60e00/0x113b6add9f8693bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f8693b6 expref: 16 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.204150:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8dc4c60e00/0x113b6add9f8693bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8693b6 expref: 16 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.204158:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8dc4c60e00, rc 0) 00000100:00100000:1.0:1789584089.204275:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+16:22582:x1876514253828608:12345-0@lo:101:mount.lustre.0 Request processed in 213us (10406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584089.204295:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789584089.204352:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253828608:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789584089.204370:0:22582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8693b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8693bd expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.204379:0:22582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8693b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f8693bd expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584089.204895:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253828736:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789584089.204938:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.204970:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc6fcb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789584089.204985:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253828736 00000100:00100000:1.0:1789584089.204990:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253828736 00000100:00100000:1.0:1789584089.205010:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789584089.205017:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+16:22582:x1876514253828736:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789584089.205031:0:21939:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789584089.205107:0:21939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789584089.205111:0:21939:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1789584089.205185:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+16:22582:x1876514253828736:12345-0@lo:256:mount.lustre.0 Request processed in 166us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584089.205224:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789584089.205256:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253828736:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789584089.205828:0:22582:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789584089.205845:0:22582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8693b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8693bd expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.205866:0:22582:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8693b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8693bd expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584089.205874:0:22582:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8def4be000 from 1 10000000:01000000:1.0:1789584089.205877:0:22582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789584089.205899:0:22582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61400/0x113b6add9f8693c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.205906:0:22582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61400/0x113b6add9f8693c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.205916:0:22582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61400/0x113b6add9f8693c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584089.205928:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253828864:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789584089.205957:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.205972:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc6fcb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789584089.206002:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253828864 00000100:00100000:1.0:1789584089.206006:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253828864 00000100:00100000:1.0:1789584089.206026:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789584089.206031:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+16:22582:x1876514253828864:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789584089.206039:0:21939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584089.206049:0:21939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8dc4c61c00/0x113b6add9f8693cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f8693c4 expref: -99 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.206065:0:21939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8dc4c61c00/0x113b6add9f8693cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f8693c4 expref: 17 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.206098:0:21939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8dc4c61c00/0x113b6add9f8693cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8693c4 expref: 17 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.206106:0:21939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8dc4c61c00, rc 0) 00000100:00100000:1.0:1789584089.206133:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:22582:x1876514253828864:12345-0@lo:101:mount.lustre.0 Request processed in 102us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584089.206139:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789584089.206169:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253828864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789584089.206179:0:22582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61400/0x113b6add9f8693c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8693cb expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.206207:0:22582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61400/0x113b6add9f8693c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f8693cb expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789584089.206712:0:22582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1789584089.208771:0:22582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789584089.209048:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789584089.209114:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1789584089.209156:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1789584089.209215:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1789584089.209253:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1789584089.209297:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1789584089.209329:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1789584089.209357:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1789584089.209400:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789584089.209433:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1789584089.209460:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1789584089.209523:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1789584089.209538:0:22582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1789584089.209861:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253828992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584089.209917:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.209997:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc6fcb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789584089.210461:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253828992 00000100:00100000:0.0:1789584089.210469:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253828992 00000100:00100000:1.0:1789584089.210567:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789584089.210864:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:22582:x1876514253828992:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584089.211231:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:22582:x1876514253828992:12345-0@lo:501:mount.lustre.0 Request processed in 654us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584089.211239:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789584089.220789:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253828992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584089.220940:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253829120:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789584089.221011:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.221095:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc6fcb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789584089.221138:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253829120 00000100:00100000:0.0:1789584089.221146:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253829120 00000100:00100000:3.0:1789584089.221329:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789584089.221340:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:22582:x1876514253829120:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789584089.221675:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:22582:x1876514253829120:12345-0@lo:503:mount.lustre.0 Request processed in 336us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584089.221684:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789584089.221883:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253829120:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789584089.222394:0:22582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789584089.222466:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253829248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584089.222516:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.222553:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df763ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1789584089.225722:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253829248 00000100:00100000:3.0:1789584089.225736:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253829248 00000100:00100000:3.0:1789584089.225787:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789584089.225797:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:22582:x1876514253829248:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789584089.226057:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:22582:x1876514253829248:12345-0@lo:502:mount.lustre.0 Request processed in 261us (3540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584089.226065:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789584089.229106:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253829248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789584089.229456:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789584089.229514:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1789584089.229579:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1789584089.229616:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1789584089.229649:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1789584089.229697:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1789584089.229731:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1789584089.229764:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1789584089.229823:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789584089.229861:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1789584089.229892:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1789584089.229935:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253829376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584089.230012:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.230046:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df763ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789584089.230074:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253829376 00000100:00100000:1.0:1789584089.230097:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253829376 00000100:00100000:1.0:1789584089.230145:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789584089.230153:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:22582:x1876514253829376:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584089.230375:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:22582:x1876514253829376:12345-0@lo:502:mount.lustre.0 Request processed in 221us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584089.230383:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789584089.230437:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253829376:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789584089.230522:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1789584089.230842:0:22582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789584089.236688:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789584089.236703:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584089.236705:0:22593:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789584089.236712:0:22593:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8def4be000 00000020:00000080:3.0:1789584089.236714:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789584089.236730:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789584089.236733:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584089.236734:0:22593:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789584089.236737:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789584089.236739:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584089.236740:0:22593:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789584089.236743:0:22593:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8def4be000 00000020:00000080:3.0:1789584089.236745:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789584089.236798:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789584089.238498:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584089.238504:0:22593:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789584089.238511:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789584089.238517:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584089.238519:0:22593:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789584089.238524:0:22593:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8def4be000 00000020:00000080:3.0:1789584089.238526:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789584089.238573:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789584089.252440:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584089.252447:0:22593:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789584089.252459:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789584089.252465:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584089.252466:0:22593:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789584089.252471:0:22593:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8def4be000 00000020:00000080:3.0:1789584089.252474:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789584089.253171:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789584089.253176:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584089.253178:0:22593:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789584089.253181:0:22593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1789584089.255391:0:22582:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789584089.255431:0:22582:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789584089.255455:0:22582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61400/0x113b6add9f8693c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8693cb expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584089.255475:0:22582:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61400/0x113b6add9f8693c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8693cb expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789584089.255529:0:22582:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789584089.255532:0:22582:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8def4be000 10000000:01000000:0.0:1789584089.255535:0:22582:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8def4be000 10000000:01000000:0.0:1789584089.255539:0:22582:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789584089.255551:0:22582:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8def4be000 from 1 10000000:01000000:0.0:1789584089.255553:0:22582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789584089.255590:0:22582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031800/0x113b6add9f8693d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584089.255598:0:22582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031800/0x113b6add9f8693d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584089.255609:0:22582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031800/0x113b6add9f8693d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584089.255632:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253829504:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789584089.255696:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584089.255740:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc2e7d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789584089.256437:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253829504 00000100:00100000:1.0:1789584089.256446:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253829504 00000100:00100000:1.0:1789584089.256494:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789584089.256505:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:22582:x1876514253829504:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789584089.256518:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584089.256532:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8dc4c60000/0x113b6add9f8693d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f8693d2 expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.258602:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8dc4c60000/0x113b6add9f8693d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f8693d2 expref: 18 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.258624:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8dc4c60000/0x113b6add9f8693d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8693d2 expref: 18 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.258645:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8dc4c60000, rc 0) 00000100:00100000:1.0:1789584089.259362:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:22582:x1876514253829504:12345-0@lo:101:mount.lustre.0 Request processed in 2220us (3027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584089.259371:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789584089.259449:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253829504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789584089.259467:0:22582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031800/0x113b6add9f8693d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8693d9 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.259477:0:22582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031800/0x113b6add9f8693d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f8693d9 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789584089.263144:0:22582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:1.0:1789584089.263502:0:22582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789584089.263751:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1789584089.263795:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1789584089.263827:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1789584089.263887:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1789584089.263922:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1789584089.263966:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1789584089.263999:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1789584089.265620:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1789584089.265707:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1789584089.265744:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1789584089.265775:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1789584089.265823:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1789584089.265859:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1789584089.265889:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1789584089.265933:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1789584089.265982:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1789584089.266015:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1789584089.266068:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1789584089.266122:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1789584089.266178:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1789584089.266254:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1789584089.266287:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1789584089.266319:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1789584089.266364:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1789584089.266401:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1789584089.266437:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1789584089.266486:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1789584089.266523:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1789584089.266559:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1789584089.266624:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1789584089.266662:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1789584089.266693:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1789584089.266722:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1789584089.266770:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1789584089.266808:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1789584089.266870:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1789584089.266905:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1789584089.266940:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1789584089.266988:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1789584089.267022:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1789584089.267055:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1789584089.267103:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1789584089.267153:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1789584089.267214:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1789584089.267252:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1789584089.267302:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1789584089.267340:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1789584089.267376:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1789584089.267504:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1789584089.267541:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1789584089.267624:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1789584089.267632:0:22582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1789584089.267755:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253829632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584089.267821:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.267874:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253829632 00000100:00100000:1.0:1789584089.267881:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253829632 00000100:00100000:1.0:1789584089.267923:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789584089.267931:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:22582:x1876514253829632:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584089.268167:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:22582:x1876514253829632:12345-0@lo:501:mount.lustre.0 Request processed in 222us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584089.268175:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789584089.268238:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df763eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789584089.268258:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253829632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584089.268289:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253829760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789584089.268325:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.268347:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253829760 00000100:00100000:1.0:1789584089.268351:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253829760 00000100:00100000:1.0:1789584089.268374:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789584089.268380:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:22582:x1876514253829760:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789584089.276374:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:22582:x1876514253829760:12345-0@lo:503:mount.lustre.0 Request processed in 7984us (8038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584089.276388:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789584089.276456:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df763eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789584089.276481:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253829760:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789584089.279673:0:22582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789584089.279768:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253829888:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584089.279847:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.279887:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253829888 00000100:00100000:1.0:1789584089.279894:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253829888 00000100:00100000:1.0:1789584089.279936:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789584089.279945:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:22582:x1876514253829888:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584089.280160:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:22582:x1876514253829888:12345-0@lo:502:mount.lustre.0 Request processed in 215us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584089.280168:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789584089.280248:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df763eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789584089.280269:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253829888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789584089.280522:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1789584089.280571:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1789584089.280607:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1789584089.280655:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1789584089.280694:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1789584089.280742:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1789584089.280777:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1789584089.280811:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1789584089.280860:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1789584089.280894:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1789584089.280929:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1789584089.280976:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1789584089.281027:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1789584089.281060:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1789584089.281118:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1789584089.281153:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1789584089.281228:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1789584089.281277:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1789584089.281310:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1789584089.281341:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1789584089.281384:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1789584089.281421:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000100:00080000:2.0:1789584089.282276:0:21950:0:(import.c:65:import_set_state_nolock()) ffff8f8dede97000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789584089.282356:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3453:x1876514253827968:12345-0@lo:38:llog_process_th.0 Request processed in 105886us (106081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584089.282366:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789584089.282391:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789584089.282399:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3453:x1876514253828096:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789584089.282438:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3453:x1876514253828096:12345-0@lo:38:kworker.0 Request processed in 38us (106118us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789584089.282443:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789584089.282881:0:3453:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789584089.282891:0:3453:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789584089.282899:0:3453:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789584089.282905:0:3453:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789584089.282908:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dc7225000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789584089.282962:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253827968:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789584089.282980:0:3453:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789584089.282984:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4758800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789584089.282987:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789584089.282990:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253828096:0@lo:38:kworker.0 00000040:00080000:1.0:1789584089.283113:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1789584089.283177:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1789584089.283248:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1789584089.283284:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1789584089.283337:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1789584089.283373:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1789584089.284526:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1789584089.285299:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1789584089.285340:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1789584089.289487:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1789584089.289641:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1789584089.289722:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1789584089.289759:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1789584089.289821:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1789584089.289858:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1789584089.289892:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1789584089.289941:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1789584089.289979:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1789584089.290013:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1789584089.290047:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1789584089.290126:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1789584089.290167:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1789584089.290227:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1789584089.290279:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1789584089.290314:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1789584089.290366:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1789584089.290441:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253830016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584089.290520:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.293764:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253830016 00000100:00100000:1.0:1789584089.293778:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253830016 00000100:00100000:1.0:1789584089.293829:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789584089.293839:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:22582:x1876514253830016:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584089.294242:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:22582:x1876514253830016:12345-0@lo:502:mount.lustre.0 Request processed in 403us (3721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584089.294251:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789584089.294310:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df763eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789584089.294333:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253830016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584089.294642:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253830144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789584089.294680:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789584089.295815:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1789584089.295883:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1789584089.296060:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253830272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584089.296124:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.296156:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253830272 00000100:00100000:1.0:1789584089.296163:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253830272 00000100:00100000:1.0:1789584089.296218:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789584089.296227:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:22582:x1876514253830272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584089.296376:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:22582:x1876514253830272:12345-0@lo:502:mount.lustre.0 Request processed in 149us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584089.297032:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789584089.297103:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df763eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789584089.297124:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253830272:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789584089.297261:0:22582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1789584089.297272:0:22582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000100:00100000:0.0:1789584089.302042:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253830144 00000100:00100000:0.0:1789584089.302055:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253830144 00000100:00100000:0.0:1789584089.302113:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789584089.302123:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3457:x1876514253830144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789584089.302165:0:21951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789584089.302269:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3457:x1876514253830144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (7588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584089.302287:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789584089.302415:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253830144:0@lo:41:osp-pre-0-1.0 00000020:01000004:1.0:1789584089.303741:0:22598:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789584089.303775:0:22598:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8f8dd013b380) 00000020:00000080:1.0:1789584089.303799:0:22598:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789584089.303878:0:22598:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8def4be000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789584089.303883:0:22598:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8def4be000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789584089.303886:0:22598:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8def4be000 3 00010000:00080000:1.0:1789584089.303916:0:22598:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8dc935e800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.111@tcp at head 00000100:00100000:0.0:1789584089.307298:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:1.0:1789584089.310260:0:22598:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1789584089.310462:0:22598:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789584089.310500:0:22598:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789584089.310515:0:22598:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x113b6add9f8693e7 00000100:00080000:1.0:1789584089.310525:0:22598:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789584089.310536:0:22598:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f8dc935e800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584089.315446:0:22598:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1ac700 x1876514253830400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789584089.315524:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876514253830400:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789584089.315609:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584089.316831:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253830400 00000100:00100000:3.0:1789584089.316842:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253830400 00000100:00100000:3.0:1789584089.316886:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789584089.316894:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3453:x1876514253830400:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789584089.316922:0:21946:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 742 last 0 00000020:00000080:3.0:1789584089.316966:0:21946:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x113b6add9f8693ee 00000004:00100000:3.0:1789584089.316980:0:21946:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789584089.317008:0:21946:0:(import.c:65:import_set_state_nolock()) ffff8f8df74f6000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789584089.317133:0:22598:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789584089.317158:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789584089.317163:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789584089.317165:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789584089.317168:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789584089.320690:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876514253830400:12345-0@lo:38:llog_process_th.0 Request processed in 3785us (5070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584089.320707:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1789584089.323023:0:22598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00010000:00080000:1.0:1789584089.325490:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f8dee1ac700 x1876514253830400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789584099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584089.325506:0:3453:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789584089.325518:0:3453:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789584089.325529:0:3453:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789584089.325535:0:3453:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789584089.325647:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dc935e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789584089.325656:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876514253830400:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1789584089.325697:0:22582:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789584089.325730:0:22582:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789584089.325745:0:22582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031800/0x113b6add9f8693d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8693d9 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584089.325755:0:22582:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031800/0x113b6add9f8693d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8693d9 expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789584089.325822:0:22582:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789584089.325825:0:22582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789584089.325830:0:22582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789584089.325832:0:22582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789584089.325833:0:22582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789584089.325834:0:22582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789584089.325836:0:22582:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789584089.325837:0:22582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789584089.325839:0:22582:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789584089.325842:0:22582:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789584089.325844:0:22582:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789584089.325845:0:22582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789584089.325846:0:22582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789584089.325847:0:22582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789584089.325847:0:22582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789584089.325848:0:22582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789584089.325849:0:22582:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789584089.325850:0:22582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789584089.325851:0:22582:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789584089.325886:0:22582:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789584089.325906:0:22582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253830528:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789584089.325975:0:22582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.326011:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253830528 00000100:00100000:1.0:1789584089.326018:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253830528 00000100:00100000:1.0:1789584089.326063:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789584089.326072:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:22582:x1876514253830528:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789584089.326109:0:21938:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789584089.326123:0:21938:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789584089.328292:0:22582:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df763e900 going to sleep for 11 seconds 20000000:01000000:3.0:1789584089.385848:0:21938:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789584089.385862:0:21938:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000001:00100000:3.0:1789584089.385891:0:6470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789584089.385903:0:21961:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789584089.385907:0:21961:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789584089.385929:0:21961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8df4fe8600/0x113b6add9f8693f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.385947:0:21961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8df4fe9c00/0x113b6add9f8692f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8692f2 expref: 18 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.385954:0:21961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8dc4c60e00/0x113b6add9f8693bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8693b6 expref: 18 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.385961:0:21961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8df4fe8600/0x113b6add9f8693f5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.385997:0:21961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8dc4c60e00/0x113b6add9f8693bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x113b6add9f8693b6 expref: 18 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.386012:0:21961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8dc4c60e00/0x113b6add9f8693bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x113b6add9f8693b6 expref: 18 pid: 21938 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584089.386025:0:21961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21961:1876514253830656:0@lo:104: 00000100:00100000:3.0:1789584089.391389:0:21961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789584089.391481:0:21961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8df4fe9c00/0x113b6add9f8692f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x113b6add9f8692f2 expref: 18 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.391497:0:21961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8df4fe9c00/0x113b6add9f8692f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x113b6add9f8692f2 expref: 18 pid: 21939 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584089.391511:0:21961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21961:1876514253830784:0@lo:104: 00000100:00100000:3.0:1789584089.391613:0:21961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584089.391630:0:21961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8de06ab840 going to sleep for 11 seconds 00000100:00100000:3.0:1789584089.391693:0:21929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253830656 00000100:00100000:3.0:1789584089.391701:0:21929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253830656 00000100:00100000:3.0:1789584089.391732:0:21929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253830784 00000100:00100000:3.0:1789584089.391735:0:21929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253830784 00000100:00100000:3.0:1789584089.391747:0:21929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789584089.391755:0:21929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+4:21961:x1876514253830656:12345-0@lo:104: 00010000:00010000:3.0:1789584089.391767:0:21929:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8693b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8693bd expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.391813:0:21929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789584089.391819:0:21929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+4:21961:x1876514253830656:12345-0@lo:104: Request processed in 65us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584089.391825:0:21929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789584089.391841:0:21929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789584089.391848:0:21929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+3:21961:x1876514253830784:12345-0@lo:104: 00010000:00010000:3.0:1789584089.391854:0:21929:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1e00/0x113b6add9f8692f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8692f9 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.391885:0:21929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789584089.392135:0:21929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+3:21961:x1876514253830784:12345-0@lo:104: Request processed in 286us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584089.392142:0:21929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789584089.392218:0:21961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21961:1876514253830656:0@lo:104: 00000100:00100000:3.0:1789584089.392226:0:21961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21961:1876514253830784:0@lo:104: 00010000:00010000:3.0:1789584089.392245:0:21961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8df4fe8600/0x113b6add9f8693f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.392262:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789584089.392268:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8693b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8693bd expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.392274:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc0031e00 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:3.0:1789584089.392279:0:21933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8693b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x113b6add9f8693bd expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.392287:0:21933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8693b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x113b6add9f8693bd expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789584089.392293:0:21933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8693b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x113b6add9f8693bd expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789584089.392298:0:21933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789584089.392326:0:21933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8693b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8693bd expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.392332:0:21933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789584089.392352:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8693b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8693bd expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.392369:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8693b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8693bd expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.392383:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584089.392386:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1e00/0x113b6add9f8692f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8692f9 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.392392:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8cc48c1e00 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:3.0:1789584089.392394:0:21933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1e00/0x113b6add9f8692f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x113b6add9f8692f9 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.392400:0:21933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1e00/0x113b6add9f8692f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x113b6add9f8692f9 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789584089.392406:0:21933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1e00/0x113b6add9f8692f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x113b6add9f8692f9 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789584089.392410:0:21933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789584089.392424:0:21933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1e00/0x113b6add9f8692f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8692f9 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.392429:0:21933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789584089.392436:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1e00/0x113b6add9f8692f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8692f9 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.392442:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1e00/0x113b6add9f8692f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8692f9 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.392453:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584089.392462:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584089.392463:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584089.392471:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584089.392702:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253830912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789584089.392737:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584089.392769:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789584089.392774:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253831040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789584089.392793:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584089.392860:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253830912 00000100:00100000:3.0:1789584089.392865:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253830912 00010000:00010000:3.0:1789584089.392886:0:21930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8dc4c60e00/0x113b6add9f8693bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8693b6 expref: 19 pid: 21938 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584089.392907:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253831040 00000100:00100000:3.0:1789584089.392910:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253831040 00010000:00010000:3.0:1789584089.392921:0:21930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8df4fe9c00/0x113b6add9f8692f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8692f2 expref: 20 pid: 21939 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584089.392936:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789584089.392942:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:3454:x1876514253830912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789584089.392953:0:21930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789584089.392959:0:21930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8dc4c60e00/0x113b6add9f8693bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8693b6 expref: 20 pid: 21938 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.392970:0:21930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8dc4c60e00/0x113b6add9f8693bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x113b6add9f8693b6 expref: 20 pid: 21938 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.392983:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8dc4c60e00/0x113b6add9f8693bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x113b6add9f8693b6 expref: 20 pid: 21938 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.393007:0:21930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789584089.393039:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+19:3454:x1876514253830912:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584089.393046:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789584089.393060:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789584089.393066:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:3454:x1876514253831040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789584089.393073:0:21930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789584089.393089:0:21930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8df4fe9c00/0x113b6add9f8692f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8692f2 expref: 18 pid: 21939 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.393097:0:21930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8df4fe9c00/0x113b6add9f8692f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x113b6add9f8692f2 expref: 18 pid: 21939 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.393106:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df4fe9c00/0x113b6add9f8692f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x113b6add9f8692f2 expref: 18 pid: 21939 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.393115:0:21930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8df4fe8600/0x113b6add9f8693f5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.393123:0:21930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8df4fe8600/0x113b6add9f8693f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789584089.393136:0:21930:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007228758s 00010000:00010000:3.0:1789584089.393141:0:21930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8df4fe8600/0x113b6add9f8693f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.393147:0:21930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8df4fe8600/0x113b6add9f8693f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.393163:0:21930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8df4fe8600/0x113b6add9f8693f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.393170:0:21930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8df4fe8600/0x113b6add9f8693f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.393175:0:21930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8600 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584089.393179:0:21930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8df4fe8600/0x113b6add9f8693f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.393205:0:21930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8df4fe8600/0x113b6add9f8693f5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.393218:0:21930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8df4fe8600/0x113b6add9f8693f5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.393227:0:21930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789584089.393251:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:3454:x1876514253831040:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584089.393257:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789584089.393292:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253831040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789584089.393300:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253830912:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789584089.393319:0:21961:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8df4fe8600/0x113b6add9f8693f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.393326:0:21961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8df4fe8600/0x113b6add9f8693f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584089.393341:0:21961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df4fe8600/0x113b6add9f8693f5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584089.406852:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+16:22582:x1876514253830528:12345-0@lo:253:mount.lustre.0 Request processed in 80771us (80868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584089.406869:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789584089.406975:0:22582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:22582:1876514253830528:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789584089.406990:0:22582:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789584089.406993:0:22582:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789584089.406995:0:22582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789584089.406997:0:22582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789584089.406998:0:22582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789584089.406999:0:22582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789584089.407000:0:22582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789584089.407015:0:22582:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789584089.407016:0:22582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789584089.407018:0:22582:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789584089.407033:0:22582:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789584089.409794:0:22582:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/8/4) registered 00080000:10000000:2.0:1789584089.409971:0:22582:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789584089.410501:0:22582:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789584089.410830:0:22582:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789584089.411317:0:22582:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789584089.411484:0:22582:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789584089.412706:0:22582:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789584089.412873:0:22582:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789584089.416427:0:22582:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789584089.416807:0:22582:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789584089.417608:0:22582:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x9:0x0] (8/8/4) registered 00080000:10000000:3.0:1789584089.417774:0:22582:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:3.0:1789584089.419504:0:22582:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1789584089.419795:0:22605:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789584089.419799:0:22605:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789584089.419923:0:22606:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1789584089.419990:0:22606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789584089.424514:0:22606:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789584089.426223:0:22606:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1789584089.426486:0:22582:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789584089.426984:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ad500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22607:1876514253831168:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789584089.427049:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.427093:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc44580c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789584089.427221:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253831168 00000100:00100000:0.0:1789584089.427229:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253831168 00000100:00100000:0.0:1789584089.427281:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789584089.427291:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:22607:x1876514253831168:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789584089.427373:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:22607:x1876514253831168:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 83us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584089.427380:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789584089.427418:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ad500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22607:1876514253831168:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789584089.427446:0:22607:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789584089.427471:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aaa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22607:1876514253831296:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789584089.427501:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584089.427519:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253831296 00000100:00100000:0.0:1789584089.427522:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253831296 00000100:00100000:1.0:1789584089.427641:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789584089.427650:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:22607:x1876514253831296:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789584089.427779:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:22607:x1876514253831296:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 130us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584089.427786:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789584089.427835:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dee1ba900 going to sleep for 11 seconds 00000100:00100000:0.0:1789584089.427850:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aaa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22607:1876514253831296:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789584089.428140:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aaa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:22607:1876514253831424:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789584089.428175:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584089.428272:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dee1ba780 going to sleep for 11 seconds 00000100:00100000:3.0:1789584089.428371:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253831424 00000100:00100000:3.0:1789584089.428376:0:21956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253831424 00000100:00100000:3.0:1789584089.428404:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789584089.428412:0:21956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:22607:x1876514253831424:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789584089.428463:0:21956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:22607:x1876514253831424:12345-0@lo:900:lod0001_rec0000.0 Request processed in 51us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584089.428470:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789584089.428548:0:22607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f8dee1aaa00 x1876514253831424/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789584105 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584089.428561:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aaa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:22607:1876514253831424:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789584089.428604:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ae680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22607:1876514253831552:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789584089.428632:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584089.428657:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458540 going to sleep for 11 seconds 00000100:00100000:3.0:1789584089.428760:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253831552 00000100:00100000:3.0:1789584089.428764:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253831552 00000100:00100000:3.0:1789584089.428796:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789584089.428803:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:22607:x1876514253831552:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789584089.428864:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:22607:x1876514253831552:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 61us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584089.428882:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789584089.428923:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ae680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22607:1876514253831552:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1789584089.428965:0:22607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789584089.430851:0:22582:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789584089.431007:0:22582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789584089.431444:0:22582:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789584089.431452:0:22582:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789584089.431574:0:22582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789584089.432502:0:22582:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789584089.433011:0:22582:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789584089.433049:0:22582:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789584089.434379:0:22607:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789584089.434443:0:22607:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789584089.434448:0:22607:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:3.0:1789584089.435485:0:22582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789584089.436666:0:22582:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x31:0x0] (8/8/4) registered 00000001:00000004:2.0:1789584089.446785:0:22582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1789584089.492118:0:22582:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789584089.492154:0:22582:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb71701c2f988 00100000:10000000:1.0:1789584089.492163:0:22582:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789584089.493587:0:22582:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789584089.493627:0:22582:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789584089.493641:0:22582:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789584089.493672:0:22582:0:(super25.c:182:lustre_fill_super()) lustre-mdt2/mdt2: Mount complete 00010000:00010000:3.0:1789584089.767277:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584090.332099:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00000040:00080000:0.0:1789584090.332877:0:22601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789584090.779422:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789584091.231335:0:21942:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789584091.231344:0:21942:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8def4be000 from 12 10000000:01000000:0.0:1789584091.231349:0:21942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789584091.231403:0:21942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030a00/0x113b6add9f8693fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584091.231416:0:21942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030a00/0x113b6add9f8693fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584091.231428:0:21942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030a00/0x113b6add9f8693fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584091.231458:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253831680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789584091.231525:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584091.231564:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dee1ba780 going to sleep for 11 seconds 00000100:00100000:2.0:1789584091.231645:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253831680 00000100:00100000:2.0:1789584091.231656:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253831680 00000100:00100000:2.0:1789584091.231712:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789584091.231722:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+16:21942:x1876514253831680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789584091.231737:0:21939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584091.231829:0:21939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f869403 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f8693fc expref: -99 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584091.231870:0:21939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f869403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f8693fc expref: 17 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584091.231880:0:21939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f869403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8693fc expref: 17 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584091.231889:0:21939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8cc48c1400, rc 0) 00000100:00100000:2.0:1789584091.233122:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:21942:x1876514253831680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1395us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584091.233132:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789584091.237510:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253831680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789584091.237542:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030a00/0x113b6add9f8693fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869403 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584091.237557:0:21942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030a00/0x113b6add9f8693fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f869403 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584091.237637:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253831808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789584091.237707:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584091.239379:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dee1ba780 going to sleep for 11 seconds 00000100:00100000:3.0:1789584091.243265:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253831808 00000100:00100000:3.0:1789584091.243280:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253831808 00000100:00100000:2.0:1789584091.243416:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789584091.243426:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:21942:x1876514253831808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789584091.243451:0:21938:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789584091.243465:0:21938:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789584091.243468:0:21938:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789584091.243611:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:21942:x1876514253831808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 186us (5904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584091.243620:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789584091.243660:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253831808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789584091.243717:0:21942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789584091.243728:0:21942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030a00/0x113b6add9f8693fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869403 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584091.243739:0:21942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030a00/0x113b6add9f8693fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869403 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789584091.243836:0:21942:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789584091.243838:0:21942:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8dff997800 from 12 10000000:01000000:2.0:1789584091.243841:0:21942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789584091.243872:0:21942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1800/0x113b6add9f86940a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584091.243880:0:21942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1800/0x113b6add9f86940a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584091.243890:0:21942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1800/0x113b6add9f86940a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584091.243910:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253831936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789584091.245446:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584091.245486:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dedd7ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789584091.245519:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253831936 00000100:00100000:2.0:1789584091.245525:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253831936 00000100:00100000:2.0:1789584091.245573:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789584091.245582:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:21942:x1876514253831936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789584091.245595:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584091.245615:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8cc48c1600/0x113b6add9f869411 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f86940a expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584091.245640:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8cc48c1600/0x113b6add9f869411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f86940a expref: 18 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584091.245651:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8cc48c1600/0x113b6add9f869411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f86940a expref: 18 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584091.245672:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8cc48c1600, rc 0) 00000100:00100000:2.0:1789584091.245712:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:21942:x1876514253831936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584091.245719:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789584091.245757:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253831936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789584091.245773:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1800/0x113b6add9f86940a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869411 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584091.245782:0:21942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1800/0x113b6add9f86940a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f869411 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584091.245836:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253832064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789584091.245867:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584091.245874:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dedd7ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789584091.245890:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253832064 00000100:00100000:2.0:1789584091.245894:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253832064 00000100:00100000:2.0:1789584091.245909:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789584091.247207:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:21942:x1876514253832064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789584091.247227:0:21938:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789584091.247243:0:21938:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789584091.247246:0:21938:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789584091.247359:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:21942:x1876514253832064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 509us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584091.247367:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789584091.247399:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253832064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789584091.247450:0:21942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789584091.247459:0:21942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1800/0x113b6add9f86940a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869411 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584091.247469:0:21942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1800/0x113b6add9f86940a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869411 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789584091.355908:0:22601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789584091.356398:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:0.0:1789584091.805599:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584092.381208:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:1.0:1789584092.827413:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584093.405609:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00010000:00010000:3.0:1789584093.851363:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584094.428350:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 0 seconds 00000001:02000400:3.0:1789584094.522352:0:22852:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1789584094.688057:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789584094.688062:0:12001:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789584094.688066:0:12001:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4758800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789584094.688080:0:12001:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f8cc4758800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584094.688102:0:12001:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1ae300 x1876514253832320/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789584094.688118:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789584094.688120:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789584094.688123:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789584094.688126:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789584094.688157:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789584094.688161:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789584094.688164:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789584094.688167:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789584094.688216:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3456:1876514253832192:0@lo:400:kworker.0 00000100:00100000:1.0:1789584094.688280:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584094.688325:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789584094.688332:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876514253832448:0@lo:400:kworker.0 00000100:00100000:1.0:1789584094.688357:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584094.688386:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253832320:0@lo:38:kworker.0 00000100:00100000:1.0:1789584094.688411:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584094.688573:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253832576:0@lo:400:kworker.0 00000100:00100000:1.0:1789584094.688601:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584094.689375:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789584094.689383:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876514253832704:0@lo:400:kworker.0 00000100:00100000:1.0:1789584094.689410:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584094.689504:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253832448 00000100:00100000:3.0:1789584094.689512:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253832448 00000100:00100000:3.0:1789584094.689561:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253832704 00000100:00100000:3.0:1789584094.689565:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253832704 00000100:00100000:3.0:1789584094.689582:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789584094.689590:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876514253832448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584094.689666:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253832192 00000100:00100000:1.0:1789584094.689670:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253832192 00000100:00100000:1.0:1789584094.689700:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789584094.689706:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:3456:x1876514253832192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584094.694348:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876514253832448:12345-0@lo:400:kworker.0 Request processed in 4749us (5979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584094.694364:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789584094.696487:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:3456:x1876514253832192:12345-0@lo:400:kworker.0 Request processed in 6724us (8151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584094.696500:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789584094.696638:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789584094.696651:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876514253832704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584094.696724:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876514253832704:12345-0@lo:400:kworker.0 Request processed in 77us (7313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584094.696742:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789584094.697010:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253832320 00000100:00100000:1.0:1789584094.697025:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253832320 00000100:00100000:1.0:1789584094.697043:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253832576 00000100:00100000:1.0:1789584094.697046:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253832576 00000100:00100000:1.0:1789584094.697163:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789584094.697169:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3453:x1876514253832320:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789584094.697210:0:21950:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 748 last 0 00000020:00000080:1.0:1789584094.697248:0:21950:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x113b6add9f869418 00000004:00100000:1.0:1789584094.697263:0:21950:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789584094.697269:0:21950:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:3.0:1789584094.697812:0:3454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8dee1adf80 x1876514253832704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584094.697829:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876514253832704:0@lo:400:kworker.0 00000100:00100000:1.0:1789584094.697996:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253832832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789584094.698047:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789584094.698083:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8dee1af480 x1876514253832448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584094.698092:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876514253832448:0@lo:400:kworker.0 00000100:00100000:1.0:1789584094.698102:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3456:1876514253832192:0@lo:400:kworker.0 00000100:00100000:1.0:1789584094.698135:0:21951:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789584094.698143:0:21951:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1789584094.699218:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253832832 00000100:00100000:1.0:1789584094.699228:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253832832 00000100:00100000:1.0:1789584094.699329:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789584094.699339:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3454:x1876514253832576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584094.699407:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3454:x1876514253832576:12345-0@lo:400:kworker.0 Request processed in 70us (10804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584094.699414:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789584094.699431:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789584094.702768:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253832832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789584094.702833:0:22867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789584094.702922:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253832832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 172us (4874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584094.702930:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789584094.703001:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253832832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789584094.705097:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253832576:0@lo:400:kworker.0 00000100:00080000:1.0:1789584094.734552:0:21950:0:(import.c:65:import_set_state_nolock()) ffff8f8de000a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789584094.734638:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3453:x1876514253832320:12345-0@lo:38:kworker.0 Request processed in 37467us (46225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584094.734649:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789584094.734809:0:3453:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789584094.734819:0:3453:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789584094.734825:0:3453:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789584094.734828:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4758800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789584094.734846:0:3453:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000aaa858da): req@ffff8f8dee1ab800 x1876514253825408/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584094.734869:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253832320:0@lo:38:kworker.0 00000100:00100000:1.0:1789584094.735041:0:21989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584094.735073:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789584094.735123:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253825408 00000100:00100000:0.0:1789584094.735129:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253825408 00000100:00100000:0.0:1789584094.735169:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789584094.735177:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:21989:x1876514253825408:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789584094.735271:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:21989:x1876514253825408:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584094.735278:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789584094.735303:0:21989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ab800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21989:1876514253825408:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1789584094.735333:0:21989:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789584094.735372:0:21989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ab800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21989:1876514253832960:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789584094.735403:0:21989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584094.735417:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc907c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789584094.735428:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253832960 00000100:00100000:0.0:1789584094.735443:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253832960 00000100:00100000:0.0:1789584094.735477:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789584094.735482:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21989:x1876514253832960:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789584094.735587:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21989:x1876514253832960:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 103us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584094.735593:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789584094.735618:0:21989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ab800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21989:1876514253832960:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789584094.735676:0:21989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ab800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21989:1876514253833088:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789584094.735697:0:21989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584094.735710:0:21989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc907c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789584094.735721:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253833088 00000100:00100000:0.0:1789584094.735724:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253833088 00000100:00100000:0.0:1789584094.735743:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789584094.735749:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21989:x1876514253833088:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789584094.735793:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21989:x1876514253833088:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 43us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584094.735799:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789584094.735822:0:21989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ab800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21989:1876514253833088:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1789584094.735856:0:21989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789584094.737790:0:21989:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789584094.737868:0:21989:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:0.0:1789584094.737873:0:21989:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:1.0:1789584094.738666:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253833216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789584094.738731:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584094.738855:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253833216 00000100:00100000:0.0:1789584094.738863:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253833216 00000100:00100000:0.0:1789584094.738947:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789584094.738957:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3457:x1876514253833216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789584094.739004:0:21950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789584094.739064:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3457:x1876514253833216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584094.739070:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789584094.739322:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253833216:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789584094.880534:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584095.903057:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789584096.286810:0:21981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789584096.931939:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584097.949587:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789584098.192530:0:23003:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa244d760 20000000:00000080:0.0:1789584098.192556:0:23003:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f8dd83cd000 uarg=0000000000000000 20000000:01000000:0.0:1789584098.192606:0:23003:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789584098.192616:0:23003:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789584098.192622:0:23003:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789584098.198059:0:23004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1789584098.198905:0:23003:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789584098.207497:0:23003:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789584098.207739:0:23003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86941f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584098.207767:0:23003:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8dc0030c00/0x113b6add9f8692c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8692c1 expref: 17 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584098.207776:0:23003:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8dc4c61c00/0x113b6add9f8693cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8693c4 expref: 17 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584098.207784:0:23003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86941f lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584098.207851:0:23003:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8dc4c61c00/0x113b6add9f8693cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x113b6add9f8693c4 expref: 17 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584098.207872:0:23003:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8dc4c61c00/0x113b6add9f8693cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x113b6add9f8693c4 expref: 17 pid: 21939 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584098.207890:0:23003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23003:1876514253833344:0@lo:104: 00000100:00100000:2.0:1789584098.207995:0:23003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789584098.208080:0:23003:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8dc0030c00/0x113b6add9f8692c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x113b6add9f8692c1 expref: 17 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584098.208113:0:23003:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8dc0030c00/0x113b6add9f8692c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x113b6add9f8692c1 expref: 17 pid: 21938 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584098.208123:0:23003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23003:1876514253833472:0@lo:104: 00000100:00100000:2.0:1789584098.208148:0:23003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584098.208181:0:23003:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8e00a7f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789584098.208307:0:21928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253833344 00000100:00100000:3.0:1789584098.208318:0:21928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253833344 00000100:00100000:3.0:1789584098.208366:0:21928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253833472 00000100:00100000:3.0:1789584098.208370:0:21928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253833472 00000100:00100000:3.0:1789584098.208386:0:21928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789584098.208395:0:21928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7819c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+4:23003:x1876514253833344:12345-0@lo:104: 00010000:00010000:3.0:1789584098.208410:0:21928:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61400/0x113b6add9f8693c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8693cb expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584098.208472:0:21928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789584098.208480:0:21928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7819c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+4:23003:x1876514253833344:12345-0@lo:104: Request processed in 86us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584098.208487:0:21928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789584098.208509:0:21928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789584098.208515:0:21928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7818e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+3:23003:x1876514253833472:12345-0@lo:104: 00010000:00010000:3.0:1789584098.208522:0:21928:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60800/0x113b6add9f8692c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8692c8 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584098.208556:0:21928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789584098.208561:0:21928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7818e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+3:23003:x1876514253833472:12345-0@lo:104: Request processed in 48us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584098.208574:0:21928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789584098.208595:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789584098.208601:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61400/0x113b6add9f8693c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8693cb expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584098.208609:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c61400 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:3.0:1789584098.208628:0:21933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61400/0x113b6add9f8693c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x113b6add9f8693cb expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584098.208639:0:21933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61400/0x113b6add9f8693c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x113b6add9f8693cb expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789584098.208647:0:21933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61400/0x113b6add9f8693c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x113b6add9f8693cb expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789584098.208654:0:21933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789584098.208690:0:21933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61400/0x113b6add9f8693c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8693cb expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584098.208697:0:21933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789584098.208719:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61400/0x113b6add9f8693c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8693cb expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584098.208726:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61400/0x113b6add9f8693c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8693cb expref: -99 pid: 22582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584098.208742:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584098.208745:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60800/0x113b6add9f8692c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8692c8 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584098.208762:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c60800 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:3.0:1789584098.208765:0:21933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60800/0x113b6add9f8692c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x113b6add9f8692c8 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584098.208772:0:21933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60800/0x113b6add9f8692c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x113b6add9f8692c8 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789584098.208779:0:21933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60800/0x113b6add9f8692c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x113b6add9f8692c8 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789584098.208785:0:21933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789584098.208798:0:21933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60800/0x113b6add9f8692c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8692c8 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584098.208805:0:21933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789584098.208811:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60800/0x113b6add9f8692c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8692c8 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584098.208818:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c60800/0x113b6add9f8692c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8692c8 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584098.208833:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584098.208835:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584098.208836:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789584098.209166:0:23003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23003:1876514253833344:0@lo:104: 00000100:00100000:2.0:1789584098.209179:0:23003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23003:1876514253833472:0@lo:104: 00010000:00010000:2.0:1789584098.209237:0:23003:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86941f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584098.209672:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789584098.209691:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253833600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789584098.209763:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584098.209822:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789584098.209830:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253833728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789584098.209852:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584098.209991:0:21983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253833600 00000100:00100000:0.0:1789584098.209998:0:21983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253833600 00010000:00010000:0.0:1789584098.210035:0:21983:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8dc4c61c00/0x113b6add9f8693cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8693c4 expref: 18 pid: 21939 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584098.210088:0:21983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253833728 00000100:00100000:0.0:1789584098.210093:0:21983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253833728 00010000:00010000:0.0:1789584098.210107:0:21983:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8dc0030c00/0x113b6add9f8692c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8692c1 expref: 19 pid: 21938 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584098.210125:0:21983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789584098.210133:0:21983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+19:3454:x1876514253833600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789584098.210149:0:21983:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789584098.210156:0:21983:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8dc4c61c00/0x113b6add9f8693cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8693c4 expref: 19 pid: 21939 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584098.210169:0:21983:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8dc4c61c00/0x113b6add9f8693cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x113b6add9f8693c4 expref: 19 pid: 21939 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584098.210211:0:21983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8dc4c61c00/0x113b6add9f8693cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x113b6add9f8693c4 expref: 19 pid: 21939 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584098.210241:0:21983:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789584098.210281:0:21983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:3454:x1876514253833600:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584098.210288:0:21983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789584098.210307:0:21983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789584098.210314:0:21983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:3454:x1876514253833728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789584098.210322:0:21983:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789584098.210327:0:21983:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8dc0030c00/0x113b6add9f8692c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8692c1 expref: 17 pid: 21938 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584098.210337:0:21983:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8dc0030c00/0x113b6add9f8692c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x113b6add9f8692c1 expref: 17 pid: 21938 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584098.210347:0:21983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8dc0030c00/0x113b6add9f8692c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x113b6add9f8692c1 expref: 17 pid: 21938 timeout: 851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584098.210362:0:21983:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86941f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584098.210372:0:21983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86941f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584098.210389:0:21983:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86941f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584098.210397:0:21983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86941f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584098.210404:0:21983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86941f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584098.210418:0:21983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86941f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584098.210426:0:21983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8cc48c1e00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584098.210431:0:21983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86941f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584098.210440:0:21983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86941f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584098.210454:0:21983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86941f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584098.210464:0:21983:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789584098.210489:0:21983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+16:3454:x1876514253833728:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584098.210495:0:21983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789584098.210980:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253833728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789584098.211002:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253833600:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789584098.211778:0:23003:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86941f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584098.211795:0:23003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86941f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584098.211803:0:23003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86941f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584098.974660:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789584099.744070:0:21942:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789584099.744079:0:21942:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8def4be000 from 13 10000000:01000000:0.0:1789584099.744086:0:21942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789584099.745129:0:21942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f869426 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584099.745146:0:21942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f869426 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584099.745160:0:21942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f869426 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584099.745216:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253833856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789584099.745296:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584099.745342:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc907c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789584099.747088:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253833856 00000100:00100000:2.0:1789584099.747107:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253833856 00000100:00100000:2.0:1789584099.747199:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789584099.747212:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+16:21942:x1876514253833856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789584099.747231:0:21939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584099.747252:0:21939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8cc48c0c00/0x113b6add9f86942d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f869426 expref: -99 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584099.747294:0:21939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8cc48c0c00/0x113b6add9f86942d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f869426 expref: 17 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584099.747305:0:21939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8cc48c0c00/0x113b6add9f86942d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869426 expref: 17 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584099.747314:0:21939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8cc48c0c00, rc 0) 00000100:00100000:2.0:1789584099.747378:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:21942:x1876514253833856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584099.747386:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789584099.747681:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253833856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789584099.747700:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f869426 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86942d expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584099.747709:0:21942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f869426 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f86942d expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584099.747770:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253833984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789584099.747800:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584099.747836:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc907c300 going to sleep for 11 seconds 00000100:00100000:1.0:1789584099.748276:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253833984 00000100:00100000:1.0:1789584099.748282:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253833984 00000100:00100000:1.0:1789584099.748428:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789584099.748438:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:21942:x1876514253833984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789584099.748786:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:21942:x1876514253833984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 350us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584099.748793:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789584099.750658:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253833984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789584099.750713:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253834112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789584099.750778:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584099.750827:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc907c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789584099.750959:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253834112 00000100:00100000:2.0:1789584099.750966:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253834112 00000100:00100000:2.0:1789584099.751016:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789584099.751027:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:21942:x1876514253834112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789584099.751236:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:21942:x1876514253834112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584099.751244:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789584099.751307:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253834112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789584099.752305:0:23065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789584099.752370:0:21942:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789584099.752389:0:21942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789584099.752400:0:21942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f869426 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86942d expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584099.752411:0:21942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f869426 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86942d expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789584099.752437:0:21942:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789584099.752440:0:21942:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8dff997800 from 13 10000000:01000000:2.0:1789584099.752443:0:21942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789584099.752477:0:21942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0800/0x113b6add9f869434 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584099.752484:0:21942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0800/0x113b6add9f869434 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584099.752494:0:21942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0800/0x113b6add9f869434 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584099.752513:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253834240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789584099.752575:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584099.752599:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc120f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789584099.752615:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253834240 00000100:00100000:2.0:1789584099.752620:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253834240 00000100:00100000:2.0:1789584099.752647:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789584099.752655:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+17:21942:x1876514253834240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789584099.752666:0:21937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584099.752680:0:21937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86943b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f869434 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584099.752703:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86943b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f869434 expref: 18 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584099.752713:0:21937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86943b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869434 expref: 18 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584099.752731:0:21937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8cc48c1e00, rc 0) 00000100:00100000:2.0:1789584099.752765:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:21942:x1876514253834240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584099.752771:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789584099.752809:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253834240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789584099.752821:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0800/0x113b6add9f869434 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86943b expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584099.752830:0:21942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0800/0x113b6add9f869434 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f86943b expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584099.752870:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253834368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789584099.752908:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584099.752923:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc120f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789584099.752933:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253834368 00000100:00100000:2.0:1789584099.752937:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253834368 00000100:00100000:2.0:1789584099.752952:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789584099.752958:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:21942:x1876514253834368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789584099.753218:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:21942:x1876514253834368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584099.753225:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789584099.753254:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253834368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789584099.753277:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253834496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789584099.753309:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584099.753329:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc120f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789584099.753340:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253834496 00000100:00100000:2.0:1789584099.753343:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253834496 00000100:00100000:2.0:1789584099.753360:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789584099.753365:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:21942:x1876514253834496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789584099.753493:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:21942:x1876514253834496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584099.753500:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789584099.753533:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253834496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789584099.757031:0:23066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789584099.757121:0:21942:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789584099.757147:0:21942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789584099.757159:0:21942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0800/0x113b6add9f869434 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86943b expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584099.757171:0:21942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0800/0x113b6add9f869434 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86943b expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584099.803740:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253834624:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1789584099.803941:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789584099.803947:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789584099.803950:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789584099.803966:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789584099.803999:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789584099.804003:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789584099.804006:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789584099.804008:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789584099.804051:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253834752:0@lo:400:kworker.0 00000100:00100000:0.0:1789584099.804181:0:3453:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789584089/real 1789584089] req@ffff8f8dee1aa680 x1876514253828480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584099 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584099.804224:0:3453:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8dee1aa680 x1876514253828480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584099 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584099.804235:0:3453:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789584089/real 1789584089] req@ffff8f8dee1adc00 x1876514253828352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584099 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584099.804247:0:3453:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8dee1adc00 x1876514253828352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584099 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584099.804268:0:3453:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789584084/real 1789584084] req@ffff8f8df781b480 x1876514253826432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584099 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584099.804282:0:3453:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8df781b480 x1876514253826432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584099 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584099.804290:0:3453:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789584084/real 1789584084] req@ffff8f8df781bb80 x1876514253826560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584099 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584099.804299:0:3453:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8df781bb80 x1876514253826560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584099 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789584099.804314:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dc93a0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584099.804330:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789584099.804333:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253828480:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789584099.804338:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dd1dbb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584099.804770:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789584099.804775:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253828352:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789584099.804782:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dee199800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584099.804787:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789584099.804791:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253826432:0@lo:8:kworker.0 00000100:00080000:0.0:1789584099.804795:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc3f57000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584099.804800:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789584099.804813:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253826560:0@lo:8:kworker.0 00000100:00100000:1.0:1789584099.805265:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3454:1876514253834880:0@lo:400:kworker.0 00000100:00080000:3.0:1789584099.805553:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789584099.805560:0:12001:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789584099.805563:0:12001:0:(import.c:65:import_set_state_nolock()) ffff8f8dee199800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789584099.805569:0:12001:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 738 00000100:00080000:3.0:1789584099.805574:0:12001:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789584099.805584:0:12001:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f8dee199800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1789584099.805614:0:12001:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dc4c5ca80 x1876514253835392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789584099.805630:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789584099.805633:0:12001:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789584099.805646:0:12001:0:(import.c:65:import_set_state_nolock()) ffff8f8cc3f57000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789584099.805649:0:12001:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 738 00000100:00080000:3.0:1789584099.805651:0:12001:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789584099.805657:0:12001:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f8cc3f57000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1789584099.805668:0:12001:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dc4c5dc00 x1876514253835520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789584099.805678:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789584099.805691:0:12001:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789584099.805693:0:12001:0:(import.c:65:import_set_state_nolock()) ffff8f8dd1dbb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789584099.805746:0:12001:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 742 00000100:00080000:3.0:1789584099.805749:0:12001:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789584099.805754:0:12001:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f8dd1dbb000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1789584099.805808:0:12001:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dc4c5f100 x1876514253835648/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789584099.805818:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789584099.805820:0:12001:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789584099.805822:0:12001:0:(import.c:65:import_set_state_nolock()) ffff8f8dc93a0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789584099.805825:0:12001:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 742 00000100:00080000:3.0:1789584099.805828:0:12001:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789584099.805833:0:12001:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f8dc93a0800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1789584099.805843:0:12001:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dc4c5c380 x1876514253835776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789584099.805896:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584099.805942:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253835264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789584099.805969:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584099.805989:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789584099.805996:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3457:1876514253835136:0@lo:400:kworker.0 00000100:00100000:3.0:1789584099.806022:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584099.806052:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253835136 00000100:00100000:3.0:1789584099.806060:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253835136 00000100:00100000:3.0:1789584099.806103:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789584099.806113:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3457:x1876514253835136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584099.806173:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3457:x1876514253835136:12345-0@lo:400:kworker.0 Request processed in 61us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584099.806181:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789584099.806238:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8dc4c5df80 x1876514253835136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584099.806251:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3457:1876514253835136:0@lo:400:kworker.0 00000100:00100000:0.0:1789584099.810755:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253835392:0@lo:8:kworker.0 00000400:00000100:0.0:1789584099.810848:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876514253835392 offset 0 length 520: 4 00000100:00100000:0.0:1789584099.810898:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253835520:0@lo:8:kworker.0 00000400:00000100:0.0:1789584099.810921:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876514253835520 offset 0 length 520: 4 00000100:00100000:0.0:1789584099.810933:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253835648:0@lo:8:kworker.0 00000400:00000100:0.0:1789584099.810947:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876514253835648 offset 0 length 520: 4 00000100:00100000:0.0:1789584099.810957:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253835776:0@lo:8:kworker.0 00000400:00000100:0.0:1789584099.810974:0:3453:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876514253835776 offset 0 length 520: 4 00000100:00100000:0.0:1789584099.811476:0:22867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253834752 00000100:00100000:0.0:1789584099.811485:0:22867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253834752 00000100:00100000:0.0:1789584099.811534:0:22867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253835264 00000100:00100000:0.0:1789584099.811537:0:22867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253835264 00000100:00100000:0.0:1789584099.811551:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789584099.811560:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3457:x1876514253834752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584099.811641:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3457:x1876514253834752:12345-0@lo:400:kworker.0 Request processed in 72us (5734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584099.811648:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789584099.811664:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789584099.811670:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253835264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789584099.811697:0:22867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789584099.811726:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253835264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (5756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584099.811731:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789584099.811752:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253835008:0@lo:400:kworker.0 00000100:00100000:0.0:1789584099.811781:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584099.812007:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253835008 00000100:00100000:0.0:1789584099.812012:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253835008 00000100:00100000:0.0:1789584099.812029:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789584099.812034:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253835008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584099.812068:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253835008:12345-0@lo:400:kworker.0 Request processed in 33us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584099.812073:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789584099.812113:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253835008:0@lo:400:kworker.0 00000100:00100000:0.0:1789584099.812149:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253835264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789584099.812160:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253834752:0@lo:400:kworker.0 00000100:00100000:2.0:1789584099.812919:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584099.812999:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584099.817289:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253834880 00000100:00100000:2.0:1789584099.817303:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253834880 00000100:00100000:2.0:1789584099.817364:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789584099.817373:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3454:x1876514253834880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584099.817457:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3454:x1876514253834880:12345-0@lo:400:kworker.0 Request processed in 85us (4457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584099.817464:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789584099.818292:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253834624 00000100:00100000:0.0:1789584099.818302:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253834624 00000100:00100000:0.0:1789584099.819702:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789584099.819717:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3456:x1876514253834624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789584099.819759:0:21950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789584099.819849:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3456:x1876514253834624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (6932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584099.819856:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789584099.819923:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253834624:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1789584099.820677:0:3454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8dc4c5ea00 x1876514253834880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584099.820692:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3454:1876514253834880:0@lo:400:kworker.0 00000001:00100000:0.0:1789584099.835068:0:7262:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789584099.995649:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584101.020364:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789584101.599547:0:22601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789584102.050712:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584103.068335:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789584104.072738:0:23254:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789584104.072742:0:23254:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789584104.072909:0:23254:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f8dd12e9800 00000020:01000004:2.0:1789584104.073040:0:23254:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789584104.073055:0:23254:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789584104.073068:0:23254:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f8de8074d40) 00000020:00000080:2.0:1789584104.073084:0:23254:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-zfs with refcount 2 00010000:00010000:1.0:1789584104.092723:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789584104.109736:0:23254:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789584104.110144:0:23254:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789584104.111157:0:23254:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789584104.111580:0:23254:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789584104.111816:0:23254:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:3.0:1789584104.112153:0:23254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 203: rc = 0 00100000:10000000:3.0:1789584104.112748:0:23254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 203: rc = 0 00100000:10000000:3.0:1789584104.112851:0:23254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 203: rc = 0 00100000:10000000:3.0:1789584104.113864:0:23254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 444: rc = 0 00100000:10000000:3.0:1789584104.114232:0:23254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 444: rc = 0 00100000:10000000:3.0:1789584104.114571:0:23254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 444: rc = 0 00100000:10000000:3.0:1789584104.114912:0:23254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 444: rc = 0 00100000:10000000:3.0:1789584104.115648:0:23254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 444: rc = 0 00100000:10000000:3.0:1789584104.117107:0:23254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 444: rc = 0 00000020:00000080:3.0:1789584104.118582:0:23254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789584104.118599:0:23254:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789584104.118611:0:23254:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x113b6add9f869449 00000020:01000004:3.0:1789584104.118620:0:23254:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789584104.118651:0:23254:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789584104.118655:0:23254:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789584104.118660:0:23254:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789584104.118666:0:23254:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789584104.118677:0:23254:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f8cc5cccd40) 00000020:00000080:3.0:1789584104.118689:0:23254:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789584104.120655:0:23254:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789584104.121090:0:23254:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789584104.121096:0:23254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789584104.127473:0:23254:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789584104.127487:0:23254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789584104.128649:0:23254:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789584104.128660:0:23254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789584104.135867:0:23254:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789584104.136065:0:23254:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789584104.136071:0:23254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789584104.138690:0:23254:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789584104.138702:0:23254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789584104.177848:0:23254:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789584104.178095:0:23254:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789584104.178101:0:23254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789584104.181512:0:23254:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789584104.181527:0:23254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789584104.182664:0:23254:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789584104.182673:0:23254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789584104.185744:0:23254:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789584104.186071:0:23254:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789584104.186078:0:23254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789584104.187012:0:23254:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789584104.187020:0:23254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789584104.230372:0:23254:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789584104.230616:0:23254:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789584104.230624:0:23254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789584104.235427:0:23254:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789584104.235444:0:23254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789584104.236230:0:23254:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789584104.236259:0:23254:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789584104.236265:0:23254:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789584104.254170:0:23254:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789584104.254757:0:23254:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.111@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789584104.254762:0:23254:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789584104.254763:0:23254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789584104.254765:0:23254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789584104.254766:0:23254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789584104.254767:0:23254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789584104.254768:0:23254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789584104.254770:0:23254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789584104.254771:0:23254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789584104.254772:0:23254:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789584104.254776:0:23254:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789584104.254778:0:23254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789584104.254779:0:23254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789584104.254780:0:23254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789584104.254782:0:23254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789584104.254783:0:23254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789584104.254784:0:23254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789584104.254785:0:23254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789584104.254785:0:23254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789584104.254786:0:23254:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789584104.254825:0:23254:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789584104.254929:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253835904:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789584104.254996:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.255116:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458540 going to sleep for 11 seconds 00000100:00100000:2.0:1789584104.255754:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253835904 00000100:00100000:2.0:1789584104.255763:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253835904 00000100:00100000:2.0:1789584104.255943:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789584104.255956:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:23254:x1876514253835904:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789584104.255996:0:21937:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789584104.256000:0:21937:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789584104.256004:0:21937:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789584104.270461:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:23254:x1876514253835904:12345-0@lo:253:mount.lustre.0 Request processed in 14497us (15453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584104.270477:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789584104.270653:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253835904:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789584104.270669:0:23254:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789584104.270673:0:23254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789584104.270675:0:23254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789584104.270677:0:23254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789584104.270678:0:23254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789584104.270680:0:23254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789584104.270681:0:23254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789584104.270683:0:23254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789584104.270684:0:23254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789584104.270686:0:23254:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789584104.270708:0:23254:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f8dd12e9800 from lustre-OST0000 10000000:01000000:3.0:1789584104.270741:0:23254:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789584104.270745:0:23254:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789584104.270753:0:23254:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f8de091b380 local copy 00010000:00010000:3.0:1789584104.270765:0:23254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86920b expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584104.273063:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789584104.273434:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.273543:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789584104.273604:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253836032 00000100:00100000:1.0:1789584104.273621:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253836032 00000100:00100000:1.0:1789584104.273686:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789584104.273695:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:23254:x1876514253836032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584104.273948:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:23254:x1876514253836032:12345-0@lo:501:mount.lustre.0 Request processed in 253us (808us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789584104.273955:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789584104.274074:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836032:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789584104.274094:0:23254:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789584104.274687:0:23254:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789584104.274698:0:23254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86920b expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.274719:0:23254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86920b expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789584104.274748:0:23254:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8dd12e9800 10000000:01000000:3.0:1789584104.274754:0:23254:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789584104.274760:0:23254:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789584104.274762:0:23254:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789584104.274767:0:23254:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789584104.274770:0:23254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789584104.274815:0:23254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8600/0x113b6add9f869457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.274823:0:23254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8600/0x113b6add9f869457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.274833:0:23254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8600/0x113b6add9f869457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584104.274854:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789584104.274900:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.274940:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789584104.274964:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253836160 00000100:00100000:2.0:1789584104.274970:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253836160 00000100:00100000:2.0:1789584104.275001:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789584104.275009:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+18:23254:x1876514253836160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789584104.275021:0:21937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584104.275034:0:21937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8e02046800/0x113b6add9f86945e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f869457 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584104.275061:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8e02046800/0x113b6add9f86945e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f869457 expref: 19 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584104.275084:0:21937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8e02046800/0x113b6add9f86945e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869457 expref: 19 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584104.275093:0:21937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8e02046800, rc 0) 00000100:00100000:2.0:1789584104.275137:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+19:23254:x1876514253836160:12345-0@lo:101:mount.lustre.0 Request processed in 130us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584104.275144:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789584104.275800:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789584104.275818:0:23254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8600/0x113b6add9f869457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86945e expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.275828:0:23254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8600/0x113b6add9f869457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f86945e expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789584104.278047:0:23254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1789584104.279725:0:23254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789584104.280095:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789584104.280456:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789584104.280500:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789584104.280554:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789584104.280591:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789584104.280621:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789584104.280661:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789584104.280695:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789584104.280727:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1789584104.280775:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1789584104.280828:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1789584104.280873:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1789584104.281424:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1789584104.281435:0:23254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1789584104.281562:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789584104.281633:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.281690:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458180 going to sleep for 11 seconds 00000100:00100000:1.0:1789584104.281784:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253836288 00000100:00100000:1.0:1789584104.281801:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253836288 00000100:00100000:1.0:1789584104.281864:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789584104.281873:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+19:23254:x1876514253836288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584104.282404:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+19:23254:x1876514253836288:12345-0@lo:501:mount.lustre.0 Request processed in 530us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584104.282413:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789584104.282855:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789584104.282898:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789584104.282956:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.282981:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458180 going to sleep for 11 seconds 00000100:00100000:0.0:1789584104.283082:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253836416 00000100:00100000:0.0:1789584104.283088:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253836416 00000100:00100000:0.0:1789584104.283128:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789584104.283146:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+19:23254:x1876514253836416:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789584104.283470:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+19:23254:x1876514253836416:12345-0@lo:503:mount.lustre.0 Request processed in 323us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584104.283485:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789584104.283695:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836416:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789584104.284602:0:23254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789584104.284671:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789584104.284730:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.284759:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458180 going to sleep for 11 seconds 00000100:00100000:2.0:1789584104.285063:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253836544 00000100:00100000:2.0:1789584104.285071:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253836544 00000100:00100000:2.0:1789584104.285107:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789584104.285115:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+19:23254:x1876514253836544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789584104.285363:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+19:23254:x1876514253836544:12345-0@lo:502:mount.lustre.0 Request processed in 248us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584104.285371:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789584104.285606:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789584104.285842:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1789584104.285892:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1789584104.285928:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1789584104.286374:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1789584104.286414:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1789584104.286447:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1789584104.286491:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1789584104.286526:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1789584104.286556:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1789584104.286600:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1789584104.286632:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1789584104.286678:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1789584104.286718:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789584104.286780:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.286820:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458180 going to sleep for 11 seconds 00000100:00100000:2.0:1789584104.286897:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253836672 00000100:00100000:2.0:1789584104.286904:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253836672 00000100:00100000:2.0:1789584104.286956:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789584104.286965:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+19:23254:x1876514253836672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789584104.287363:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+19:23254:x1876514253836672:12345-0@lo:502:mount.lustre.0 Request processed in 397us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584104.287370:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789584104.287512:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789584104.287599:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1789584104.287609:0:23254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1789584104.289328:0:23268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789584104.289340:0:23268:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789584104.289347:0:23268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789584104.289349:0:23268:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789584104.289355:0:23268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789584104.289371:0:23268:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f8e009d4d40) 00000020:00000080:0.0:1789584104.289394:0:23268:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789584104.289400:0:23268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789584104.289466:0:23268:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8dd12e9800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789584104.289474:0:23268:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789584104.289482:0:23268:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x113b6add9f86946c 00010000:00010000:1.0:1789584104.294332:0:23268:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1789584104.294799:0:23268:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:1.0:1789584104.297057:0:23268:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1789584104.298814:0:23268:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789584104.298827:0:23268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789584104.298834:0:23268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584104.298836:0:23268:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789584104.298840:0:23268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789584104.298843:0:23268:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1789584104.298844:0:23268:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789584104.298846:0:23268:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789584104.298847:0:23268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789584104.298850:0:23268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584104.298852:0:23268:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789584104.298855:0:23268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789584104.298858:0:23268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584104.298859:0:23268:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789584104.298872:0:23268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789584104.298874:0:23268:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789584104.298876:0:23268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789584104.298879:0:23268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584104.298880:0:23268:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789584104.298882:0:23268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789584104.298885:0:23268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584104.298886:0:23268:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789584104.298889:0:23268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789584104.298950:0:23268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789584104.298954:0:23268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584104.298955:0:23268:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789584104.298958:0:23268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1789584104.299173:0:23254:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789584104.299233:0:23254:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789584104.299252:0:23254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8600/0x113b6add9f869457 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86945e expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.299265:0:23254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8600/0x113b6add9f869457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86945e expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789584104.299286:0:23254:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8dd12e9800 from 1 10000000:01000000:3.0:1789584104.299289:0:23254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789584104.299326:0:23254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9c00/0x113b6add9f869473 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.299334:0:23254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9c00/0x113b6add9f869473 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.299345:0:23254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9c00/0x113b6add9f869473 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584104.299370:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789584104.299446:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.299497:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789584104.299657:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253836800 00000100:00100000:2.0:1789584104.299665:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253836800 00000100:00100000:2.0:1789584104.299718:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789584104.299727:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+19:23254:x1876514253836800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789584104.299744:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584104.299758:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8e02047400/0x113b6add9f86947a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f869473 expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584104.299785:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8e02047400/0x113b6add9f86947a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f869473 expref: 20 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584104.299806:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8e02047400/0x113b6add9f86947a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869473 expref: 20 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584104.299814:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8e02047400, rc 0) 00000100:00100000:2.0:1789584104.299856:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:23254:x1876514253836800:12345-0@lo:101:mount.lustre.0 Request processed in 131us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584104.299862:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789584104.300072:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789584104.300089:0:23254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9c00/0x113b6add9f869473 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86947a expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.300098:0:23254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9c00/0x113b6add9f869473 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f86947a expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789584104.300824:0:23254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1789584104.301163:0:23254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789584104.301407:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789584104.301450:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1789584104.301498:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1789584104.301536:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1789584104.301570:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1789584104.301628:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1789584104.301660:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1789584104.301688:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1789584104.301728:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1789584104.301763:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1789584104.301812:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1789584104.301902:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1789584104.301911:0:23254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1789584104.301989:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789584104.302046:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.302090:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584104.302124:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253836928 00000100:00100000:3.0:1789584104.302130:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253836928 00000100:00100000:3.0:1789584104.302165:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789584104.302173:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:23254:x1876514253836928:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789584104.302399:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:23254:x1876514253836928:12345-0@lo:501:mount.lustre.0 Request processed in 225us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584104.302407:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789584104.302451:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253836928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789584104.302481:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789584104.302515:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.302529:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584104.302542:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253837056 00000100:00100000:3.0:1789584104.302546:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253837056 00000100:00100000:3.0:1789584104.302562:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789584104.302567:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:23254:x1876514253837056:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789584104.302691:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:23254:x1876514253837056:12345-0@lo:503:mount.lustre.0 Request processed in 123us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584104.302702:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789584104.302741:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837056:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789584104.310981:0:23254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789584104.311080:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789584104.311308:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.311353:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789584104.311414:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253837184 00000100:00100000:0.0:1789584104.311422:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253837184 00000100:00100000:0.0:1789584104.311471:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789584104.311481:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:23254:x1876514253837184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789584104.311761:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:23254:x1876514253837184:12345-0@lo:502:mount.lustre.0 Request processed in 281us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584104.311769:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789584104.311834:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789584104.312080:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789584104.312131:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789584104.313609:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789584104.313650:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789584104.313682:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789584104.313727:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789584104.313765:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789584104.313813:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1789584104.313866:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1789584104.313904:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1789584104.313940:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1789584104.313988:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789584104.314061:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.314107:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789584104.315517:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253837312 00000100:00100000:2.0:1789584104.315531:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253837312 00000100:00100000:2.0:1789584104.315603:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789584104.315614:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:23254:x1876514253837312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789584104.315898:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:23254:x1876514253837312:12345-0@lo:502:mount.lustre.0 Request processed in 285us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584104.315916:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789584104.316038:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837312:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789584104.316236:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1789584104.316256:0:23254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789584104.327572:0:23272:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789584104.327587:0:23272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584104.327589:0:23272:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789584104.327597:0:23272:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8dd12e9800 00000020:00000080:3.0:1789584104.327599:0:23272:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789584104.327607:0:23272:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789584104.327609:0:23272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584104.327617:0:23272:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789584104.327620:0:23272:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789584104.327623:0:23272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584104.327624:0:23272:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789584104.327634:0:23272:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8dd12e9800 00000020:00000080:3.0:1789584104.327636:0:23272:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789584104.327704:0:23272:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789584104.327707:0:23272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584104.327708:0:23272:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789584104.327710:0:23272:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789584104.327713:0:23272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584104.327714:0:23272:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789584104.327717:0:23272:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8dd12e9800 00000020:00000080:3.0:1789584104.327719:0:23272:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789584104.327746:0:23272:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789584104.327751:0:23272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584104.327752:0:23272:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789584104.327754:0:23272:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789584104.327757:0:23272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584104.327758:0:23272:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789584104.327761:0:23272:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8dd12e9800 00000020:00000080:3.0:1789584104.327763:0:23272:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789584104.327811:0:23272:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789584104.327815:0:23272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584104.327817:0:23272:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789584104.327820:0:23272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1789584104.328139:0:23254:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789584104.328174:0:23254:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789584104.328228:0:23254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9c00/0x113b6add9f869473 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86947a expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584104.328243:0:23254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9c00/0x113b6add9f869473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86947a expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584104.328305:0:23254:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789584104.328308:0:23254:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8dd12e9800 10000000:01000000:1.0:1789584104.328312:0:23254:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8dd12e9800 10000000:01000000:1.0:1789584104.328317:0:23254:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789584104.328322:0:23254:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8dd12e9800 from 1 10000000:01000000:1.0:1789584104.328325:0:23254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789584104.328361:0:23254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61e00/0x113b6add9f869481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584104.328369:0:23254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61e00/0x113b6add9f869481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584104.328393:0:23254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61e00/0x113b6add9f869481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584104.328420:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789584104.328499:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584104.328533:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc71ddd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789584104.328715:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253837440 00000100:00100000:0.0:1789584104.328725:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253837440 00000100:00100000:0.0:1789584104.328781:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789584104.328801:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:23254:x1876514253837440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789584104.328815:0:21937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789584104.328829:0:21937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8dc0031600/0x113b6add9f869488 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f869481 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584104.328877:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8dc0031600/0x113b6add9f869488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f869481 expref: 21 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584104.328889:0:21937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8dc0031600/0x113b6add9f869488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869481 expref: 21 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584104.328899:0:21937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8dc0031600, rc 0) 00000100:00100000:0.0:1789584104.328952:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23254:x1876514253837440:12345-0@lo:101:mount.lustre.0 Request processed in 163us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584104.328958:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789584104.330230:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789584104.330266:0:23254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61e00/0x113b6add9f869481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869488 expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.330278:0:23254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61e00/0x113b6add9f869481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f869488 expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789584104.330946:0:23254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1789584104.331493:0:23254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789584104.331734:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789584104.331782:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1789584104.331835:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1789584104.331880:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1789584104.331916:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1789584104.337473:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1789584104.337575:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1789584104.337611:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1789584104.337666:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789584104.337701:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1789584104.337733:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1789584104.337782:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1789584104.337835:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1789584104.337871:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1789584104.337938:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1789584104.337971:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1789584104.337999:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1789584104.338040:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1789584104.338071:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1789584104.338100:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1789584104.338142:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1789584104.338175:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1789584104.338228:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1789584104.338271:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1789584104.338322:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1789584104.338354:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1789584104.338393:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1789584104.347147:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1789584104.347229:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1789584104.347331:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1789584104.347388:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1789584104.347422:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1789584104.347453:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1789584104.347500:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1789584104.347536:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1789584104.347581:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1789584104.347615:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1789584104.347646:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1789584104.347695:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1789584104.347749:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1789584104.347802:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1789584104.347839:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1789584104.348029:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1789584104.348067:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1789584104.348101:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1789584104.348393:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1789584104.348454:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1789584104.348494:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1789584104.348593:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1789584104.348627:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1789584104.348686:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1789584104.348694:0:23254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1789584104.348816:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789584104.351437:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.351493:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458240 going to sleep for 11 seconds 00000100:00100000:2.0:1789584104.352467:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253837568 00000100:00100000:2.0:1789584104.352480:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253837568 00000100:00100000:2.0:1789584104.352547:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789584104.352559:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23254:x1876514253837568:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789584104.355128:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23254:x1876514253837568:12345-0@lo:501:mount.lustre.0 Request processed in 2559us (3688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584104.355143:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789584104.356419:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789584104.356487:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789584104.356554:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584104.356595:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc907ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789584104.356976:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253837696 00000100:00100000:0.0:1789584104.356984:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253837696 00000100:00100000:0.0:1789584104.357034:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789584104.357046:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23254:x1876514253837696:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789584104.359022:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23254:x1876514253837696:12345-0@lo:503:mount.lustre.0 Request processed in 1969us (2458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584104.359036:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789584104.359213:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837696:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789584104.362069:0:23254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789584104.362178:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837824:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789584104.363499:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584104.363550:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458000 going to sleep for 11 seconds 00000100:00100000:3.0:1789584104.364019:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253837824 00000100:00100000:3.0:1789584104.364036:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253837824 00000100:00100000:3.0:1789584104.364133:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789584104.364144:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23254:x1876514253837824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789584104.364538:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23254:x1876514253837824:12345-0@lo:502:mount.lustre.0 Request processed in 395us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584104.364547:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789584104.369702:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837824:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789584104.370020:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1789584104.370087:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1789584104.370146:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1789584104.370217:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1789584104.370775:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1789584104.370863:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1789584104.370901:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1789584104.370950:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1789584104.370999:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1789584104.371034:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1789584104.371068:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1789584104.371116:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1789584104.371149:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1789584104.371176:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1789584104.371636:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1789584104.371670:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1789584104.371696:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1789584104.371737:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1789584104.371800:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1789584104.371837:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1789584104.372444:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1789584104.372482:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1789584104.372513:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1789584104.372557:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1789584104.372592:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1789584104.372621:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1789584104.372669:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1789584104.372707:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1789584104.372744:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1789584104.372816:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1789584104.374404:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1789584104.374475:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1789584104.374504:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1789584104.374563:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1789584104.374621:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1789584104.374667:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1789584104.374699:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1789584104.374732:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1789584104.374781:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1789584104.374832:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1789584104.376020:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1789584104.376064:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1789584104.376127:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1789584104.376165:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1789584104.376395:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1789584104.376447:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1789584104.376478:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1789584104.376980:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1789584104.377063:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837952:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789584104.377144:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584104.377296:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc6e5d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789584104.382622:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253837952 00000100:00100000:1.0:1789584104.382640:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253837952 00000100:00100000:1.0:1789584104.382759:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789584104.382771:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23254:x1876514253837952:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584104.383088:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23254:x1876514253837952:12345-0@lo:502:mount.lustre.0 Request processed in 319us (5943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584104.383096:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789584104.383920:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253837952:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789584104.384095:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1789584104.384166:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1789584104.384227:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253838080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789584104.384283:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584104.385862:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc6e5d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584104.386167:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253838080 00000100:00100000:3.0:1789584104.386178:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253838080 00000100:00100000:3.0:1789584104.389119:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789584104.389133:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23254:x1876514253838080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789584104.389488:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23254:x1876514253838080:12345-0@lo:502:mount.lustre.0 Request processed in 357us (5204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584104.389497:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789584104.391007:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253838080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789584104.391231:0:23254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1789584104.391408:0:23254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789584104.394815:0:23278:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789584104.394833:0:23278:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f8dd0138000) 00000020:00000080:1.0:1789584104.395037:0:23278:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1789584104.395138:0:23278:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8dd12e9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789584104.395143:0:23278:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8dd12e9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789584104.395146:0:23278:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8dd12e9800 3 00010000:00080000:1.0:1789584104.395179:0:23278:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8cc5414000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.111@tcp at head 00010000:00010000:1.0:1789584104.398156:0:23278:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789584104.398632:0:23278:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789584104.398672:0:23278:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789584104.398684:0:23278:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x113b6add9f869496 00000100:00080000:1.0:1789584104.398696:0:23278:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789584104.398705:0:23278:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f8cc5414000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584104.398741:0:23278:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1ae300 x1876514253838208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789584104.398784:0:23278:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789584104.398887:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3453:1876514253838208:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789584104.398957:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789584104.399052:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584104.399057:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789584104.399060:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584104.399063:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789584104.399089:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584104.399093:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789584104.399095:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584104.399098:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789584104.399410:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253838336:0@lo:400:kworker.0 00000100:00100000:1.0:1789584104.399450:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584104.400885:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253838208 00000100:00100000:2.0:1789584104.400898:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253838208 00000100:00100000:2.0:1789584104.400936:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789584104.400944:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3453:x1876514253838208:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789584104.400974:0:21947:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 757 last 0 00000020:00000080:2.0:1789584104.401018:0:21947:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x113b6add9f86949d 00000004:00100000:2.0:1789584104.401033:0:21947:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789584104.401067:0:21947:0:(import.c:65:import_set_state_nolock()) ffff8f8df623b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789584104.401134:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1876514253838208:12345-0@lo:38:llog_process_th.0 Request processed in 190us (2178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584104.401142:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789584104.401175:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876514253838464:0@lo:400:kworker.0 00000100:00100000:2.0:1789584104.401222:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584104.401351:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253838592:0@lo:400:kworker.0 00000100:00100000:2.0:1789584104.401388:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3457:1876514253838720:0@lo:400:kworker.0 00000100:00100000:2.0:1789584104.401409:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584104.401433:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253838464 00000100:00100000:2.0:1789584104.401437:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253838464 00000100:00100000:2.0:1789584104.401455:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253838720 00000100:00100000:2.0:1789584104.401457:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253838720 00000100:00100000:2.0:1789584104.401467:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789584104.401472:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876514253838464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584104.401508:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876514253838464:12345-0@lo:400:kworker.0 Request processed in 35us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584104.401514:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789584104.401526:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789584104.401536:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3457:x1876514253838720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584104.401562:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3457:x1876514253838720:12345-0@lo:400:kworker.0 Request processed in 26us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584104.401567:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789584104.401600:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8dee1ae300 x1876514253838208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789584114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584104.401610:0:3453:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789584104.401617:0:3453:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1789584104.401625:0:3453:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789584104.401629:0:3453:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789584104.401631:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc5414000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789584104.401637:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3453:1876514253838208:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789584104.401664:0:3455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8df7818380 x1876514253838464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584104.401672:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876514253838464:0@lo:400:kworker.0 00010000:00080000:2.0:1789584104.401688:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8df781b480 x1876514253838720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584104.401696:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3457:1876514253838720:0@lo:400:kworker.0 00000020:01000004:1.0:1789584104.406772:0:23278:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789584104.406802:0:23278:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8f8dd01399c0) 00000020:00000080:1.0:1789584104.406827:0:23278:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1789584104.406921:0:23278:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8dd12e9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789584104.406926:0:23278:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8dd12e9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789584104.406929:0:23278:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8dd12e9800 3 00010000:00080000:1.0:1789584104.406960:0:23278:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8cc5414800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.111@tcp at head 00010000:00010000:1.0:1789584104.408623:0:23278:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1789584104.408805:0:23278:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789584104.408838:0:23278:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789584104.408853:0:23278:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x113b6add9f8694ab 00000100:00080000:1.0:1789584104.408862:0:23278:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789584104.408872:0:23278:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8f8cc5414800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584104.408908:0:23278:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1ae300 x1876514253838848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789584104.408928:0:23278:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789584104.409062:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253838336 00000100:00100000:0.0:1789584104.409070:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253838336 00000100:00100000:0.0:1789584104.409113:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789584104.409121:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253838336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584104.409226:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253838336:12345-0@lo:400:kworker.0 Request processed in 105us (9775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584104.409233:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789584104.409293:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253838336:0@lo:400:kworker.0 00000100:00100000:2.0:1789584104.409729:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584104.409773:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3453:1876514253838848:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789584104.409832:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789584104.409867:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584104.409871:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789584104.409879:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584104.409882:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789584104.409885:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584104.409888:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789584104.409891:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584104.409893:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789584104.410012:0:22867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253838592 00000100:00100000:2.0:1789584104.410016:0:22867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253838592 00000100:00100000:2.0:1789584104.410041:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789584104.410047:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253838592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584104.410084:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253838592:12345-0@lo:400:kworker.0 Request processed in 37us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584104.410089:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789584104.410107:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253838848 00000100:00100000:2.0:1789584104.410110:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253838848 00000100:00100000:2.0:1789584104.410125:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789584104.410129:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3453:x1876514253838848:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789584104.410149:0:21945:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 757 last 0 00000020:00000080:2.0:1789584104.410180:0:21945:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x113b6add9f8694b2 00000004:00100000:2.0:1789584104.410210:0:21945:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789584104.410234:0:21945:0:(import.c:65:import_set_state_nolock()) ffff8f8df623c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789584104.410340:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3453:x1876514253838848:12345-0@lo:38:llog_process_th.0 Request processed in 209us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584104.410347:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789584104.410389:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253838592:0@lo:400:kworker.0 00010000:00080000:2.0:1789584104.410413:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8dee1ae300 x1876514253838848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789584114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584104.410422:0:3453:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789584104.410427:0:3453:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1789584104.410433:0:3453:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789584104.410439:0:3453:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789584104.410441:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc5414800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789584104.410446:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3453:1876514253838848:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789584104.415556:0:23278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1789584104.415705:0:23254:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789584104.415739:0:23254:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789584104.415763:0:23254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61e00/0x113b6add9f869481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869488 expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.415777:0:23254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61e00/0x113b6add9f869481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869488 expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789584104.415914:0:23254:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789584104.415918:0:23254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789584104.415919:0:23254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789584104.415920:0:23254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789584104.415921:0:23254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789584104.415923:0:23254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789584104.415924:0:23254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789584104.415925:0:23254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789584104.415927:0:23254:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789584104.415936:0:23254:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789584104.415938:0:23254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789584104.415940:0:23254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789584104.415940:0:23254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789584104.415941:0:23254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789584104.415942:0:23254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789584104.415943:0:23254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789584104.415944:0:23254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789584104.415945:0:23254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789584104.415946:0:23254:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789584104.415973:0:23254:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789584104.415994:0:23254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253838976:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789584104.416065:0:23254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.416100:0:23254:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8cc4458cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584104.416121:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253838976 00000100:00100000:3.0:1789584104.416128:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253838976 00000100:00100000:3.0:1789584104.416170:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789584104.416179:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23254:x1876514253838976:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789584104.416241:0:21937:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789584104.416938:0:21937:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789584104.456772:0:21937:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789584104.456801:0:21937:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789584104.457132:0:21961:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789584104.457137:0:21961:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789584104.457159:0:21961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8dc0031e00/0x113b6add9f8694b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584104.457178:0:21961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f869403 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8693fc expref: 21 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584104.457205:0:21961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8cc48c1600/0x113b6add9f869411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f86940a expref: 21 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584104.457213:0:21961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8dc0031e00/0x113b6add9f8694b9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584104.457256:0:21961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8cc48c1600/0x113b6add9f869411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x113b6add9f86940a expref: 21 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584104.457271:0:21961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8cc48c1600/0x113b6add9f869411 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x113b6add9f86940a expref: 21 pid: 21938 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584104.457286:0:21961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21961:1876514253839104:0@lo:104: 00000100:00100000:0.0:1789584104.457351:0:21961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789584104.457403:0:21961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f869403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x113b6add9f8693fc expref: 21 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584104.457412:0:21961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f869403 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x113b6add9f8693fc expref: 21 pid: 21939 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584104.457420:0:21961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21961:1876514253839232:0@lo:104: 00000100:00100000:0.0:1789584104.457444:0:21961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584104.457470:0:21961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc6e5d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584104.457606:0:21929:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789584104.457624:0:21929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253839104 00000100:00100000:3.0:1789584104.457631:0:21929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253839104 00000100:00100000:3.0:1789584104.457664:0:21929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253839232 00000100:00100000:3.0:1789584104.457666:0:21929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253839232 00000100:00100000:3.0:1789584104.457680:0:21929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789584104.457689:0:21929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+4:21961:x1876514253839104:12345-0@lo:104: 00010000:00010000:3.0:1789584104.457703:0:21929:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1800/0x113b6add9f86940a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f869411 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.457764:0:21929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789584104.457775:0:21929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+4:21961:x1876514253839104:12345-0@lo:104: Request processed in 88us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584104.457782:0:21929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789584104.457812:0:21929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789584104.457818:0:21929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defd2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+3:21961:x1876514253839232:12345-0@lo:104: 00010000:00010000:3.0:1789584104.457825:0:21929:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030a00/0x113b6add9f8693fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f869403 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584104.457957:0:21961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21961:1876514253839104:0@lo:104: 00010000:00010000:3.0:1789584104.458019:0:21929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789584104.458025:0:21929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defd2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+3:21961:x1876514253839232:12345-0@lo:104: Request processed in 208us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584104.458032:0:21929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789584104.458073:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789584104.458080:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1800/0x113b6add9f86940a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f869411 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458087:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8cc48c1800 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:3.0:1789584104.458092:0:21933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1800/0x113b6add9f86940a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x113b6add9f869411 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458101:0:21933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1800/0x113b6add9f86940a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x113b6add9f869411 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789584104.458108:0:21933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1800/0x113b6add9f86940a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x113b6add9f869411 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789584104.458114:0:21933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789584104.458143:0:21933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1800/0x113b6add9f86940a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f869411 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458159:0:21933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789584104.458181:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1800/0x113b6add9f86940a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f869411 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458206:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c1800/0x113b6add9f86940a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f869411 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458218:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584104.458221:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030a00/0x113b6add9f8693fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f869403 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458226:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc0030a00 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:3.0:1789584104.458229:0:21933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030a00/0x113b6add9f8693fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x113b6add9f869403 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458236:0:21933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030a00/0x113b6add9f8693fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x113b6add9f869403 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789584104.458242:0:21933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030a00/0x113b6add9f8693fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x113b6add9f869403 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789584104.458248:0:21933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789584104.458261:0:21933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030a00/0x113b6add9f8693fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f869403 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458268:0:21933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789584104.458274:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030a00/0x113b6add9f8693fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f869403 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458281:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030a00/0x113b6add9f8693fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f869403 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458301:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584104.458303:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584104.458304:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584104.458311:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584104.458328:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3455:1876514253839488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789584104.458360:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.458389:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789584104.458395:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3455:1876514253839360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789584104.458418:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584104.458446:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253839488 00000100:00100000:3.0:1789584104.458450:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253839488 00010000:00010000:3.0:1789584104.458470:0:21932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f869403 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8693fc expref: 22 pid: 21939 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584104.458489:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253839360 00000100:00100000:3.0:1789584104.458492:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253839360 00010000:00010000:3.0:1789584104.458502:0:21932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8cc48c1600/0x113b6add9f869411 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f86940a expref: 23 pid: 21938 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584104.458520:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789584104.458527:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:3455:x1876514253839488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789584104.458539:0:21932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789584104.458544:0:21932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f869403 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8693fc expref: 23 pid: 21939 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458553:0:21932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f869403 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x113b6add9f8693fc expref: 23 pid: 21939 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458577:0:21932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789584104.458604:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:3455:x1876514253839488:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584104.458611:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789584104.458624:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789584104.458629:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd35a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:3455:x1876514253839360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789584104.458637:0:21932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789584104.458641:0:21932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8cc48c1600/0x113b6add9f869411 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f86940a expref: 22 pid: 21938 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458650:0:21932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8cc48c1600/0x113b6add9f869411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x113b6add9f86940a expref: 22 pid: 21938 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458659:0:21932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8cc48c1600/0x113b6add9f869411 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x113b6add9f86940a expref: 22 pid: 21938 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458669:0:21932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8dc0031e00/0x113b6add9f8694b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458677:0:21932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8dc0031e00/0x113b6add9f8694b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789584104.458689:0:21932:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007228758s 00010000:00010000:3.0:1789584104.458695:0:21932:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8dc0031e00/0x113b6add9f8694b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458702:0:21932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8dc0031e00/0x113b6add9f8694b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458718:0:21932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8dc0031e00/0x113b6add9f8694b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458725:0:21932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8dc0031e00/0x113b6add9f8694b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458731:0:21932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc0031e00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584104.458735:0:21932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8dc0031e00/0x113b6add9f8694b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458743:0:21932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8dc0031e00/0x113b6add9f8694b9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458752:0:21932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8dc0031e00/0x113b6add9f8694b9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584104.458762:0:21932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789584104.458784:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd35a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:3455:x1876514253839360:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584104.458805:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789584104.458980:0:21961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8cc48c1400/0x113b6add9f869403 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x113b6add9f8693fc expref: 20 pid: 21939 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584104.458990:0:21961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21961:1876514253839232:0@lo:104: 00010000:00010000:2.0:1789584104.459007:0:21961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8dc0031e00/0x113b6add9f8694b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584104.459016:0:21961:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8dc0031e00/0x113b6add9f8694b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584104.459022:0:21961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8dc0031e00/0x113b6add9f8694b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584104.459028:0:21961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8dc0031e00/0x113b6add9f8694b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584104.459735:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3455:1876514253839360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789584104.459746:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3455:1876514253839488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789584104.467076:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+19:23254:x1876514253838976:12345-0@lo:253:mount.lustre.0 Request processed in 50887us (51000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584104.467092:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789584104.467180:0:23254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23254:1876514253838976:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789584104.467231:0:23254:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789584104.467234:0:23254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789584104.467236:0:23254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789584104.467238:0:23254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789584104.467239:0:23254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789584104.467241:0:23254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789584104.467248:0:23254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789584104.467249:0:23254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789584104.467251:0:23254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789584104.467252:0:23254:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789584104.467267:0:23254:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789584104.467623:0:23254:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789584104.467753:0:23254:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789584104.467892:0:23254:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789584104.468012:0:23254:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789584104.468125:0:23254:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789584104.468294:0:23254:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789584104.469435:0:23254:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1789584104.507177:0:23254:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789584104.507382:0:23254:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789584104.507481:0:23254:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789584104.507539:0:23254:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789584104.507556:0:23254:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789584104.507588:0:23254:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000100:00100000:2.0:1789584104.923717:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253839616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789584104.923853:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584104.923909:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789584104.923916:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253839744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789584104.923942:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584104.923984:0:22867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253839616 00000100:00100000:2.0:1789584104.923995:0:22867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253839616 00000100:00100000:2.0:1789584104.924053:0:22867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253839744 00000100:00100000:2.0:1789584104.924057:0:22867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253839744 00000100:00100000:2.0:1789584104.924077:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789584104.924088:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253839616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789584104.924156:0:22867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789584104.924248:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253839616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584104.924256:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789584104.924283:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789584104.924289:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253839744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789584104.924313:0:22867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789584104.924344:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253839744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584104.924350:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789584104.924408:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253839744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789584104.924422:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253839616:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789584105.118863:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789584105.948941:0:21942:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789584105.948947:0:21942:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8def4be000 from 13 10000000:01000000:2.0:1789584105.948951:0:21942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789584105.948992:0:21942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8e02046600/0x113b6add9f8694c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584105.949011:0:21942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8e02046600/0x113b6add9f8694c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584105.949022:0:21942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8e02046600/0x113b6add9f8694c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584105.949048:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253839872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789584105.949116:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584105.949160:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8def481c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789584105.955901:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253839872 00000100:00100000:3.0:1789584105.955915:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253839872 00000100:00100000:3.0:1789584105.957330:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789584105.957346:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+19:21942:x1876514253839872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789584105.957367:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789584105.957391:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8df4fe9600/0x113b6add9f8694c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f8694c0 expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584105.957420:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8df4fe9600/0x113b6add9f8694c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f8694c0 expref: 20 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584105.957432:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8df4fe9600/0x113b6add9f8694c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8694c0 expref: 20 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584105.957442:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8df4fe9600, rc 0) 00000100:00100000:3.0:1789584105.957516:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:21942:x1876514253839872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (8400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584105.957523:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789584105.957594:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253839872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789584105.957613:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8e02046600/0x113b6add9f8694c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8694c7 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584105.957624:0:21942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8e02046600/0x113b6add9f8694c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f8694c7 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584105.957696:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253840000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789584105.957735:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584105.958626:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc2eef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789584105.962003:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253840000 00000100:00100000:2.0:1789584105.962018:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253840000 00000100:00100000:2.0:1789584105.962066:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789584105.962078:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:21942:x1876514253840000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789584105.962103:0:21937:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789584105.962120:0:21937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789584105.962122:0:21937:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1789584105.962298:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:21942:x1876514253840000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 223us (4563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584105.962307:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789584105.962463:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253840000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789584105.962551:0:21942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789584105.962563:0:21942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8e02046600/0x113b6add9f8694c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8694c7 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584105.963016:0:21942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8e02046600/0x113b6add9f8694c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8694c7 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789584105.963031:0:21942:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789584105.963042:0:21942:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8dff997800 from 13 10000000:01000000:0.0:1789584105.963045:0:21942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789584105.963081:0:21942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030400/0x113b6add9f8694ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584105.963090:0:21942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030400/0x113b6add9f8694ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584105.963099:0:21942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030400/0x113b6add9f8694ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584105.963120:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253840128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789584105.963158:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584105.963217:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc907cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789584105.963257:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253840128 00000100:00100000:3.0:1789584105.963263:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253840128 00000100:00100000:3.0:1789584105.963297:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789584105.963304:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:21942:x1876514253840128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789584105.963314:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789584105.963326:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8df4fe8000/0x113b6add9f8694d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f8694ce expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584105.963347:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8df4fe8000/0x113b6add9f8694d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f8694ce expref: 21 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584105.963357:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8df4fe8000/0x113b6add9f8694d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8694ce expref: 21 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584105.963365:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8df4fe8000, rc 0) 00000100:00100000:3.0:1789584105.963393:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:21942:x1876514253840128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584105.963398:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789584105.963610:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253840128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789584105.963624:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030400/0x113b6add9f8694ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8694d5 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584105.963632:0:21942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030400/0x113b6add9f8694ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f8694d5 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584105.963678:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253840256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789584105.963712:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584105.963736:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc907cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789584105.963750:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253840256 00000100:00100000:0.0:1789584105.963754:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253840256 00000100:00100000:0.0:1789584105.963785:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789584105.963792:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:21942:x1876514253840256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789584105.963805:0:21937:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789584105.963825:0:21937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789584105.963828:0:21937:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789584105.963902:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:21942:x1876514253840256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584105.963909:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789584105.964445:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253840256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789584105.964504:0:21942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789584105.964512:0:21942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030400/0x113b6add9f8694ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8694d5 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584105.964520:0:21942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030400/0x113b6add9f8694ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8694d5 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584106.141809:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789584106.526773:0:21981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789584107.171908:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584108.188912:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584109.212704:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789584109.533734:0:20556:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584109.533740:0:20556:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789584109.533743:0:20556:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584109.533746:0:20556:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789584109.533770:0:20556:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584109.533782:0:20556:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789584109.533785:0:20556:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584109.533787:0:20556:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789584109.533828:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253840384:0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.533901:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584109.533940:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876514253840896:0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.533964:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584109.533989:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789584109.533995:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253840512:0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.534020:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584109.534037:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3454:1876514253841024:0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.534055:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584109.534076:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876514253840640:0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.534094:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584109.534105:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253841152:0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.534120:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584109.534129:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789584109.534133:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df781a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253840768:0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.534147:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584109.534173:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253840384 00000100:00100000:2.0:1789584109.534180:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253840384 00000100:00100000:2.0:1789584109.534243:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789584109.534251:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:3454:x1876514253840384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.534298:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:3454:x1876514253840384:12345-0@lo:400:kworker.0 Request processed in 48us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584109.534311:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789584109.534347:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253840896 00000100:00100000:2.0:1789584109.534351:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253840896 00000100:00100000:2.0:1789584109.534369:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253841024 00000100:00100000:2.0:1789584109.534372:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253841024 00000100:00100000:2.0:1789584109.534400:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253840640 00000100:00100000:2.0:1789584109.534403:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253840640 00000100:00100000:2.0:1789584109.534412:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253841152 00000100:00100000:2.0:1789584109.534414:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253841152 00000100:00100000:2.0:1789584109.534426:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789584109.534431:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876514253840896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.534461:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876514253840896:12345-0@lo:400:kworker.0 Request processed in 30us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584109.534467:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789584109.534477:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789584109.534482:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3454:x1876514253841024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.534501:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3454:x1876514253841024:12345-0@lo:400:kworker.0 Request processed in 19us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584109.534506:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789584109.534514:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789584109.534519:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876514253840640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.534541:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876514253840640:12345-0@lo:400:kworker.0 Request processed in 22us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584109.534546:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789584109.534554:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789584109.534560:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876514253841152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.534590:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876514253841152:12345-0@lo:400:kworker.0 Request processed in 30us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584109.534595:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789584109.534609:0:22867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253840512 00000100:00100000:2.0:1789584109.534612:0:22867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253840512 00000100:00100000:2.0:1789584109.534629:0:22867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253840768 00000100:00100000:2.0:1789584109.534631:0:22867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253840768 00000100:00100000:2.0:1789584109.534640:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789584109.534645:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253840512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.534671:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253840512:12345-0@lo:400:kworker.0 Request processed in 25us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584109.534676:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789584109.534684:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789584109.534702:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253840768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.534728:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253840768:12345-0@lo:400:kworker.0 Request processed in 39us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584109.534732:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789584109.534775:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253840512:0@lo:400:kworker.0 00010000:00080000:2.0:1789584109.534788:0:3454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8df7819c00 x1876514253841024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584109.534797:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3454:1876514253841024:0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.534805:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253840384:0@lo:400:kworker.0 00010000:00080000:2.0:1789584109.534814:0:3454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8df781a680 x1876514253840896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584109.534822:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876514253840896:0@lo:400:kworker.0 00000100:00100000:2.0:1789584109.534864:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253840768:0@lo:400:kworker.0 00010000:00080000:2.0:1789584109.534874:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8df781bb80 x1876514253840640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584109.534881:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df781bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876514253840640:0@lo:400:kworker.0 00010000:00080000:2.0:1789584109.534890:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8df7818e00 x1876514253841152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584109.534897:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253841152:0@lo:400:kworker.0 00000100:00080000:0.0:1789584109.538448:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789584109.538459:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789584110.053235:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253841280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789584110.053312:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584110.053374:0:22867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253841280 00000100:00100000:2.0:1789584110.053382:0:22867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253841280 00000100:00100000:2.0:1789584110.053432:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789584110.053442:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253841280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789584110.053483:0:22867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789584110.053527:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253841280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584110.053534:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789584110.053580:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253841280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789584110.064568:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789584110.064598:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253841408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789584110.064698:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584110.064753:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253841408 00000100:00100000:1.0:1789584110.064761:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253841408 00000100:00100000:1.0:1789584110.064818:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789584110.064838:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253841408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789584110.064895:0:21951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789584110.064950:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253841408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584110.064957:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789584110.065273:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253841408:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789584110.236538:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584111.259302:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789584111.285583:0:23624:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:2.0:1789584111.836863:0:22601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789584112.284550:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584113.310428:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584114.331540:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584114.652746:0:3453:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789584099/real 1789584099] req@ffff8f8dc4c5f100 x1876514253835648/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584114 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584114.652783:0:3453:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8dc4c5f100 x1876514253835648/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584114 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584114.652792:0:3453:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789584099/real 1789584099] req@ffff8f8dc4c5c380 x1876514253835776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584114 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584114.652803:0:3453:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8dc4c5c380 x1876514253835776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584114 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789584114.652845:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dd1dbb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584114.652860:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789584114.652864:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253835648:0@lo:8:kworker.0 00000100:00080000:0.0:1789584114.652869:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dc93a0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789584114.652874:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789584114.652876:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253835776:0@lo:8:kworker.0 00000100:00080000:0.0:1789584114.652976:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789584114.652980:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789584114.652984:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789584114.652986:0:12001:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789584114.653000:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789584114.653002:0:12001:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789584114.653005:0:12001:0:(import.c:65:import_set_state_nolock()) ffff8f8dd1dbb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789584114.653009:0:12001:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 753 00000100:00080000:0.0:1789584114.653014:0:12001:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789584114.653025:0:12001:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f8dd1dbb000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1789584114.653043:0:12001:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1a8380 x1876514253842048/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789584114.653054:0:12001:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789584114.653056:0:12001:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789584114.653057:0:12001:0:(import.c:65:import_set_state_nolock()) ffff8f8dc93a0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789584114.653060:0:12001:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 753 00000100:00080000:0.0:1789584114.653068:0:12001:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789584114.653073:0:12001:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f8dc93a0800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1789584114.653084:0:12001:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dee1ab800 x1876514253842176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789584114.653119:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3455:1876514253841536:0@lo:400:kworker.0 00000100:00100000:0.0:1789584114.653185:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584114.653263:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876514253842304:0@lo:400:kworker.0 00000100:00100000:0.0:1789584114.653288:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584114.653306:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789584114.653312:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253841920:0@lo:400:kworker.0 00000100:00100000:0.0:1789584114.653337:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584114.653364:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253842048:0@lo:8:kworker.0 00000100:00100000:0.0:1789584114.653385:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584114.653399:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253842176:0@lo:8:kworker.0 00000100:00100000:0.0:1789584114.653414:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584114.653458:0:23255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253842048 00000100:00100000:0.0:1789584114.653466:0:23255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253842048 00000100:00100000:0.0:1789584114.653502:0:23255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253842176 00000100:00100000:0.0:1789584114.653505:0:23255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253842176 00000100:00100000:0.0:1789584114.653519:0:23255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789584114.653527:0:23255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3453:x1876514253842048:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789584114.653574:0:23255:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 767 last 0 00000020:00000080:0.0:1789584114.653810:0:23255:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x113b6add9f8694dc 00002000:00100000:0.0:1789584114.653828:0:23255:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8f8cc4776800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789584114.653832:0:23255:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1789584114.653842:0:23255:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789584114.654370:0:23255:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789584114.654402:0:23255:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4772000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789584114.654479:0:23255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3453:x1876514253842048:12345-0@lo:8:kworker.0 Request processed in 950us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584114.654489:0:23255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789584114.654517:0:23255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789584114.654523:0:23255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3453:x1876514253842176:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789584114.654539:0:23255:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789584114.656497:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253841664:0@lo:400:kworker.0 00000100:00100000:2.0:1789584114.656758:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584114.656819:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3456:1876514253842432:0@lo:400:kworker.0 00000100:00100000:2.0:1789584114.656846:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584114.656871:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789584114.656878:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876514253841792:0@lo:400:kworker.0 00000100:00100000:2.0:1789584114.656900:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584114.656915:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253842560:0@lo:400:kworker.0 00000100:00100000:2.0:1789584114.656934:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584114.656966:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253841536 00000100:00100000:2.0:1789584114.656973:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253841536 00000100:00100000:2.0:1789584114.657020:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789584114.657030:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:3455:x1876514253841536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584114.657087:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:3455:x1876514253841536:12345-0@lo:400:kworker.0 Request processed in 59us (3901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584114.657094:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789584114.657130:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253842304 00000100:00100000:2.0:1789584114.657135:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253842304 00000100:00100000:2.0:1789584114.657154:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253842432 00000100:00100000:2.0:1789584114.657157:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253842432 00000100:00100000:2.0:1789584114.657178:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253841792 00000100:00100000:2.0:1789584114.657181:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253841792 00000100:00100000:3.0:1789584114.657735:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253841920 00000100:00100000:3.0:1789584114.657742:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253841920 00000100:00100000:3.0:1789584114.657777:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253841664 00000100:00100000:3.0:1789584114.657780:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253841664 00000100:00100000:3.0:1789584114.657796:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789584114.657803:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253841920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584114.657850:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253841920:12345-0@lo:400:kworker.0 Request processed in 47us (4510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584114.657869:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789584114.657884:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789584114.657890:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253841664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584114.657927:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253841664:12345-0@lo:400:kworker.0 Request processed in 38us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584114.657934:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789584114.658175:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253842560 00000100:00100000:2.0:1789584114.658180:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253842560 00000100:00100000:3.0:1789584114.658266:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789584114.658274:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876514253842304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584114.658312:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876514253842304:12345-0@lo:400:kworker.0 Request processed in 38us (5023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584114.658318:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789584114.658335:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789584114.658341:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876514253842432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584114.658371:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876514253842432:12345-0@lo:400:kworker.0 Request processed in 31us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584114.658376:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789584114.658388:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789584114.658394:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876514253841792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584114.658420:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876514253841792:12345-0@lo:400:kworker.0 Request processed in 26us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584114.658425:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789584114.658730:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789584114.658738:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876514253842560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584114.658770:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876514253842560:12345-0@lo:400:kworker.0 Request processed in 33us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584114.658776:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789584114.658808:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789584114.658820:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789584114.658852:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8dee1a9500 x1876514253841792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584114.658867:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876514253841792:0@lo:400:kworker.0 00010000:00080000:2.0:1789584114.658878:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8dee1aaa00 x1876514253842560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584114.658887:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253842560:0@lo:400:kworker.0 00000100:00100000:2.0:1789584114.658898:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253841664:0@lo:400:kworker.0 00010000:00080000:2.0:1789584114.658907:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8dee1a8000 x1876514253842432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584114.658914:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3456:1876514253842432:0@lo:400:kworker.0 00000100:00100000:2.0:1789584114.658952:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253841920:0@lo:400:kworker.0 00000100:00100000:2.0:1789584114.658963:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3455:1876514253841536:0@lo:400:kworker.0 00010000:00080000:2.0:1789584114.658974:0:3455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8dee1a9f80 x1876514253842304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584114.658982:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876514253842304:0@lo:400:kworker.0 00010000:00080000:1.0:1789584114.664854:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8dee1a8380 x1876514253842048/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789584134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584114.664870:0:3453:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789584114.664879:0:3453:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789584114.664890:0:3453:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789584114.664897:0:3453:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789584114.664901:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dd1dbb000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789584114.664916:0:3453:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789584114.664924:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253842048:0@lo:8:kworker.0 00000004:00080000:1.0:1789584114.664993:0:22590:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789584114.665032:0:22590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22590:1876514253842816:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1789584114.665089:0:22590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584114.665115:0:22590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc2eef3c0 going to sleep for 11 seconds 00000004:00080000:1.0:1789584114.665129:0:22589:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789584114.665494:0:22589:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 767981305032ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789584114.665529:0:23258:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789584114.665536:0:23258:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789584114.665657:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253842688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789584114.665689:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584114.665747:0:23258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253842816 00000100:00100000:1.0:1789584114.665755:0:23258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253842816 00000100:00100000:1.0:1789584114.665859:0:23759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789584114.665868:0:23759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:22590:x1876514253842816:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789584114.667104:0:23259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253842688 00000100:00100000:2.0:1789584114.667113:0:23259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253842688 00000100:00100000:2.0:1789584114.667154:0:23259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789584114.667163:0:23259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3454:x1876514253842688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789584114.667221:0:23259:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789584114.667289:0:23259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3454:x1876514253842688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584114.667304:0:23259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789584114.667328:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789584114.667648:0:3454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8dee1aca80 x1876514253842688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789584130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584114.667669:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253842688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789584114.694320:0:23255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3453:x1876514253842176:12345-0@lo:8:kworker.0 Request processed in 39787us (40894us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789584114.694336:0:23255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789584114.694409:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dc93a0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789584114.694415:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789584114.694419:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253842176:0@lo:8:kworker.0 00002000:00080000:0.0:1789584114.696345:0:23759:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789584114.696355:0:23759:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1789584114.696438:0:23759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:22590:x1876514253842816:12345-0@lo:7:osp-pre-0-1.0 Request processed in 30568us (31344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584114.696449:0:23759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789584114.698672:0:22590:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8dee1ae300 x1876514253842816/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789584130 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584114.698691:0:22590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22590:1876514253842816:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1789584114.698706:0:22590:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789584114.698911:0:22590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22590:1876514253842944:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789584114.698974:0:22590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584114.699007:0:22590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc6e5d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789584114.699566:0:23258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253842944 00000100:00100000:1.0:1789584114.699575:0:23258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253842944 00000100:00100000:1.0:1789584114.700011:0:23258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789584114.700026:0:23258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22590:x1876514253842944:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789584114.700060:0:23258:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789584114.700121:0:23258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22590:x1876514253842944:12345-0@lo:5:osp-pre-0-1.0 Request processed in 100us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584114.700128:0:23258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789584114.700167:0:22590:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8df4fa0000 x1876514253842944/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789584130 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584114.700458:0:22590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22590:1876514253842944:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789584114.700474:0:22590:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789584114.700512:0:22590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22590:1876514253843072:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789584114.700551:0:22590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584114.700570:0:22590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc6e5d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789584114.702103:0:23255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253843072 00000100:00100000:1.0:1789584114.702116:0:23255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253843072 00000100:00100000:1.0:1789584114.703852:0:23255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789584114.703880:0:23255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:22590:x1876514253843072:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789584114.703941:0:23255:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000004:00080000:0.0:1789584114.721570:0:7262:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00100000:3.0:1789584114.735531:0:8131:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789584114.737551:0:23255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:22590:x1876514253843072:12345-0@lo:5:osp-pre-0-1.0 Request processed in 33674us (36990us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789584114.737564:0:23255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789584114.737629:0:22590:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8df4fa0000 x1876514253843072/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789584130 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584114.737651:0:22590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22590:1876514253843072:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789584114.737680:0:22590:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1789584114.737726:0:22590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f2a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:22590:1876514253843200:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789584114.737762:0:22590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584114.737784:0:22590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dee1ba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789584114.738129:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253843200 00000100:00100000:0.0:1789584114.738143:0:21957:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253843200 00000100:00100000:0.0:1789584114.738260:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789584114.738271:0:21957:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22590:x1876514253843200:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789584114.738324:0:21957:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22590:x1876514253843200:12345-0@lo:900:osp-pre-0-1.0 Request processed in 56us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584114.738330:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789584114.738633:0:22590:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8df4f2a680 x1876514253843200/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789584130 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584114.738645:0:22590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f2a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:22590:1876514253843200:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789584115.164057:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789584115.164081:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253843328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789584115.164154:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584115.164500:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253843328 00000100:00100000:3.0:1789584115.164509:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253843328 00000100:00100000:3.0:1789584115.164569:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789584115.164607:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253843328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789584115.164650:0:21951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789584115.164704:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253843328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584115.164711:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789584115.164793:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253843328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789584115.165435:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789584115.165448:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253843456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789584115.165492:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584115.165574:0:22867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253843456 00000100:00100000:0.0:1789584115.165590:0:22867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253843456 00000100:00100000:0.0:1789584115.165633:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789584115.165641:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253843456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789584115.165667:0:22867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789584115.165710:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253843456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584115.165718:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789584115.165753:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253843456:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789584115.355386:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584116.384265:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789584116.765877:0:21981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789584117.403345:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584118.427483:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584119.452886:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584119.772046:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253843584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789584119.772167:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584119.774404:0:3453:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789584099/real 1789584099] req@ffff8f8dc4c5ca80 x1876514253835392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584119 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584119.774442:0:3453:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8dc4c5ca80 x1876514253835392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584119 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584119.774454:0:3453:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789584099/real 1789584099] req@ffff8f8dc4c5dc00 x1876514253835520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584119 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584119.774467:0:3453:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f8dc4c5dc00 x1876514253835520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789584119 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789584119.774500:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dee199800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789584119.774526:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789584119.774531:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253835392:0@lo:8:kworker.0 00000100:00080000:1.0:1789584119.774538:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc3f57000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789584119.774564:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789584119.774567:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253835520:0@lo:8:kworker.0 00000100:00100000:2.0:1789584119.775688:0:23259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253843584 00000100:00100000:2.0:1789584119.775704:0:23259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253843584 00000100:00100000:2.0:1789584119.775780:0:23259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789584119.775791:0:23259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3457:x1876514253843584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789584119.777951:0:23259:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789584119.778111:0:23259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3457:x1876514253843584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2316us (5937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584119.778123:0:23259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789584119.778356:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8dc4c5fb80 x1876514253843584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789584135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584119.778390:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253843584:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789584119.779155:0:20556:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584119.779160:0:20556:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789584119.779164:0:20556:0:(import.c:65:import_set_state_nolock()) ffff8f8dee199800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789584119.779170:0:20556:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 753 00000100:00080000:2.0:1789584119.779176:0:20556:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789584119.779420:0:20556:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f8dee199800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1789584119.779451:0:20556:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8defc74380 x1876514253843968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789584119.779474:0:20556:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584119.779500:0:20556:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789584119.779503:0:20556:0:(import.c:65:import_set_state_nolock()) ffff8f8cc3f57000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789584119.779507:0:20556:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 753 00000100:00080000:2.0:1789584119.779511:0:20556:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789584119.779524:0:20556:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f8cc3f57000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584119.779524:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253843968:0@lo:8:kworker.0 00000100:00100000:2.0:1789584119.779544:0:20556:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8defc74a80 x1876514253844096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789584119.779582:0:20556:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789584119.779586:0:20556:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789584119.779588:0:20556:0:(import.c:65:import_set_state_nolock()) ffff8f8dc93a0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789584119.779592:0:20556:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 767 00000100:00080000:2.0:1789584119.779595:0:20556:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789584119.779600:0:20556:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f8dc93a0800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1789584119.779613:0:20556:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8defc75c00 x1876514253844480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789584119.779622:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789584119.779678:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789584119.779691:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253844096:0@lo:8:kworker.0 00000100:00100000:2.0:1789584119.779698:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253843840:0@lo:400:kworker.0 00000100:00100000:3.0:1789584119.779854:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253843712:0@lo:400:kworker.0 00000100:00100000:1.0:1789584119.782945:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584119.784231:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584119.784333:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3455:1876514253844736:0@lo:400:kworker.0 00000100:00100000:2.0:1789584119.784414:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584119.784519:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876514253844224:0@lo:400:kworker.0 00000100:00100000:2.0:1789584119.784551:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584119.784572:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253844864:0@lo:400:kworker.0 00000100:00100000:2.0:1789584119.784595:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584119.784632:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789584119.784640:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253844352:0@lo:400:kworker.0 00000100:00100000:2.0:1789584119.784669:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584119.785046:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584119.785093:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876514253844608:0@lo:400:kworker.0 00000100:00100000:3.0:1789584119.785120:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584119.785187:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253844480:0@lo:8:kworker.0 00000100:00100000:1.0:1789584119.785253:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584119.785297:0:23258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253843968 00000100:00100000:1.0:1789584119.785310:0:23258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253843968 00000100:00100000:1.0:1789584119.785356:0:23258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253844096 00000100:00100000:1.0:1789584119.785360:0:23258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253844096 00000100:00100000:1.0:1789584119.785368:0:23258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253844480 00000100:00100000:1.0:1789584119.785370:0:23258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253844480 00000100:00100000:1.0:1789584119.785385:0:23258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789584119.786236:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253844736 00000100:00100000:3.0:1789584119.786248:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253844736 00000100:00100000:3.0:1789584119.786322:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253844224 00000100:00100000:3.0:1789584119.786326:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253844224 00000100:00100000:3.0:1789584119.786341:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253844864 00000100:00100000:3.0:1789584119.786344:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253844864 00000100:00100000:3.0:1789584119.786358:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253844608 00000100:00100000:3.0:1789584119.786360:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253844608 00000100:00100000:3.0:1789584119.786374:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789584119.786399:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876514253844736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584119.786518:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876514253844736:12345-0@lo:400:kworker.0 Request processed in 121us (2103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584119.786526:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789584119.786546:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789584119.786553:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876514253844224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584119.786583:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876514253844224:12345-0@lo:400:kworker.0 Request processed in 31us (2032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584119.786588:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789584119.786599:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789584119.786605:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876514253844864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584119.786634:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876514253844864:12345-0@lo:400:kworker.0 Request processed in 29us (2037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584119.786639:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789584119.786650:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789584119.786656:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876514253844608:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789584119.786834:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8defc76d80 x1876514253844224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584119.786933:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876514253844224:0@lo:400:kworker.0 00010000:00080000:2.0:1789584119.787024:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8dee1aca80 x1876514253844864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584119.787036:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253844864:0@lo:400:kworker.0 00000100:00100000:3.0:1789584119.787612:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876514253844608:12345-0@lo:400:kworker.0 Request processed in 953us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584119.787623:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789584119.787652:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789584119.787659:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789584119.788205:0:23258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3453:x1876514253843968:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789584119.788261:0:23258:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 773 last 0 00000020:00000080:1.0:1789584119.788303:0:23258:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x113b6add9f8694e3 00002000:00100000:1.0:1789584119.788322:0:23258:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f8cc5411000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789584119.788327:0:23258:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789584119.788330:0:23258:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789584119.788555:0:23258:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789584119.788595:0:23258:0:(import.c:65:import_set_state_nolock()) ffff8f8cc5417800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789584119.788685:0:23258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3453:x1876514253843968:12345-0@lo:8:kworker.0 Request processed in 3289us (9066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584119.788695:0:23258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789584119.788745:0:23258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789584119.788753:0:23258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3453:x1876514253844096:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789584119.788768:0:23258:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789584119.788892:0:23258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3453:x1876514253844096:12345-0@lo:8:kworker.0 Request processed in 49us (5872us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789584119.788902:0:23258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789584119.788917:0:23258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789584119.788922:0:23258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3453:x1876514253844480:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789584119.788934:0:23258:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789584119.788966:0:23258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3453:x1876514253844480:12345-0@lo:8:kworker.0 Request processed in 42us (3713us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789584119.788972:0:23258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789584119.789098:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc3f57000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789584119.789106:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789584119.789110:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253844096:0@lo:8:kworker.0 00000100:00080000:1.0:1789584119.789124:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dc93a0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789584119.789128:0:3453:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789584119.789131:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253844480:0@lo:8:kworker.0 00010000:00080000:1.0:1789584119.789148:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8defc74380 x1876514253843968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789584144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584119.789162:0:3453:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789584119.789172:0:3453:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789584119.789184:0:3453:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789584119.789220:0:3453:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789584119.789222:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dee199800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789584119.789255:0:3453:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789584119.789263:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253843968:0@lo:8:kworker.0 00000004:00080000:1.0:1789584119.789349:0:21970:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:1.0:1789584119.789383:0:21970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21970:1876514253845120:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789584119.791453:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253844992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789584119.792426:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253843840 00000100:00100000:0.0:1789584119.792444:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253843840 00000100:00100000:0.0:1789584119.792546:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253844352 00000100:00100000:0.0:1789584119.792551:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253844352 00000100:00100000:0.0:1789584119.792574:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789584119.792586:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253843840:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789584119.793827:0:3455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8dee1ae300 x1876514253844736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584119.793860:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3455:1876514253844736:0@lo:400:kworker.0 00010000:00080000:3.0:1789584119.793935:0:3454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8defc77480 x1876514253844608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584119.793963:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876514253844608:0@lo:400:kworker.0 00000100:00100000:1.0:1789584119.799906:0:21970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789584119.800038:0:21969:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1789584119.800065:0:23258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253845120 00000100:00100000:3.0:1789584119.800078:0:23258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253845120 00000100:00100000:3.0:1789584119.800158:0:23258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789584119.800170:0:23258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:21970:x1876514253845120:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789584119.805288:0:21969:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773121096219ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789584119.805423:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789584119.805446:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253844352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584119.806836:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253844352:12345-0@lo:400:kworker.0 Request processed in 1390us (22154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584119.806854:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789584119.806937:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253843712 00000100:00100000:1.0:1789584119.806949:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253843712 00000100:00100000:1.0:1789584119.807183:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789584119.807212:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:3454:x1876514253843712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584119.807299:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:3454:x1876514253843712:12345-0@lo:400:kworker.0 Request processed in 90us (22253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584119.807306:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789584119.807380:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253844352:0@lo:400:kworker.0 00000100:00100000:1.0:1789584119.807459:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253843712:0@lo:400:kworker.0 00000100:00100000:2.0:1789584119.808725:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584119.810803:0:23259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253844992 00000100:00100000:2.0:1789584119.810831:0:23259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253844992 00000100:00100000:2.0:1789584119.811553:0:23259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789584119.811569:0:23259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3457:x1876514253844992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789584119.811606:0:23259:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789584119.812074:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789584119.812999:0:23259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3457:x1876514253844992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1425us (4271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584119.813015:0:23259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789584119.814120:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8df4fa0a80 x1876514253844992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789584135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584119.814156:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253844992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789584119.817680:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253843840:12345-0@lo:400:kworker.0 Request processed in 25083us (33443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584119.817699:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789584119.817806:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253843840:0@lo:400:kworker.0 00002000:00080000:3.0:1789584119.818727:0:23258:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789584119.818739:0:23258:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1789584119.818746:0:23258:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000100:00100000:1.0:1789584119.836053:0:21970:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8de06ab9c0 going to sleep for 11 seconds 00002000:00010000:3.0:1789584119.857660:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789584119.857681:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec5f3c91/0x113b6add9f8694ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.857705:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1789584119.857710:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584119.857718:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec5f3c91/0x113b6add9f8694ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.857740:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec5f3c91/0x113b6add9f8694ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.857753:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec5f3c91/0x113b6add9f8694ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.857762:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec5f3c91/0x113b6add9f8694ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.857804:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789584119.857833:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584119.857841:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec5f3c91/0x113b6add9f8694ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.857850:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8c00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584119.857856:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec5f3c91/0x113b6add9f8694ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.857880:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec5f3c91/0x113b6add9f8694ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.858378:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec5f3c91/0x113b6add9f8694ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.858387:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec5f3c91/0x113b6add9f8694ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.858413:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584119.858415:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584119.858417:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789584119.864785:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789584119.864807:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f74c87c/0x113b6add9f8694f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.864859:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=773s v=(0 0) 00010000:00010000:3.0:1789584119.865641:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584119.865655:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f74c87c/0x113b6add9f8694f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.865677:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f74c87c/0x113b6add9f8694f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.865692:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f74c87c/0x113b6add9f8694f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.865703:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f74c87c/0x113b6add9f8694f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.873339:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789584119.873375:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584119.873386:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f74c87c/0x113b6add9f8694f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.873405:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe9e00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584119.873412:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f74c87c/0x113b6add9f8694f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.873426:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f74c87c/0x113b6add9f8694f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.873641:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f74c87c/0x113b6add9f8694f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.873666:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f74c87c/0x113b6add9f8694f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.873695:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584119.873697:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584119.873699:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789584119.875282:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789584119.875297:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f8694f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.875324:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=773s v=(0 0) 00010000:00010000:2.0:1789584119.875330:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789584119.875338:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f8694f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.875358:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f8694f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.875369:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f8694f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.875379:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f8694f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.875402:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789584119.875670:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584119.875679:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f8694f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.875689:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8e02047000 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584119.875694:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f8694f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.875705:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f8694f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.875726:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f8694f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.875734:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f8694f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.875757:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584119.875759:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584119.875778:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789584119.881400:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789584119.881420:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079b76ea3/0x113b6add9f8694ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.881588:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=773s v=(0 0) 00010000:00010000:2.0:1789584119.881595:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789584119.881603:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079b76ea3/0x113b6add9f8694ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.881623:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079b76ea3/0x113b6add9f8694ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.881650:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079b76ea3/0x113b6add9f8694ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.881658:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079b76ea3/0x113b6add9f8694ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.881740:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789584119.882745:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789584119.882757:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f869506 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.882772:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=773s v=(0 0) 00010000:00010000:2.0:1789584119.882777:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789584119.882782:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f869506 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.882796:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f869506 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.882805:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f869506 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.882813:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f869506 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.883180:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789584119.883368:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079b76ea3/0x113b6add9f8694ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.883380:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8e02046200 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584119.883387:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079b76ea3/0x113b6add9f8694ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.883399:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079b76ea3/0x113b6add9f8694ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.883425:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079b76ea3/0x113b6add9f8694ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.883434:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079b76ea3/0x113b6add9f8694ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.883584:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584119.883589:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f869506 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.883597:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8e02047000 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584119.883601:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f869506 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.883609:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f869506 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.883637:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f869506 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.883647:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584119.883649:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584119.883652:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584119.883801:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789584119.883808:0:23258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000974a9e08/0x113b6add9f869506 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789584119.884945:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789584119.884959:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f5b03f/0x113b6add9f86950d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.884977:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=773s v=(0 0) 00010000:00010000:2.0:1789584119.884982:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789584119.884989:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032f5b03f/0x113b6add9f86950d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.885005:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032f5b03f/0x113b6add9f86950d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.885015:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f5b03f/0x113b6add9f86950d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.885024:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032f5b03f/0x113b6add9f86950d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.885828:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584119.885841:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032f5b03f/0x113b6add9f86950d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.885853:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8e02046e00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584119.885859:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f5b03f/0x113b6add9f86950d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.885997:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f5b03f/0x113b6add9f86950d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.886022:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032f5b03f/0x113b6add9f86950d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.886035:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584119.886037:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584119.886039:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584119.886163:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789584119.886172:0:23258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032f5b03f/0x113b6add9f86950d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789584119.887169:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789584119.887178:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbaadaa3/0x113b6add9f869514 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.887230:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=773s v=(0 0) 00010000:00010000:2.0:1789584119.887236:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789584119.887243:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbaadaa3/0x113b6add9f869514 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.887258:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbaadaa3/0x113b6add9f869514 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.887269:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbaadaa3/0x113b6add9f869514 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.887277:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbaadaa3/0x113b6add9f869514 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.887734:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584119.887744:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbaadaa3/0x113b6add9f869514 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.887768:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8e02046000 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584119.887773:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbaadaa3/0x113b6add9f869514 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.887784:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbaadaa3/0x113b6add9f869514 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.887804:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbaadaa3/0x113b6add9f869514 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.887813:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584119.887815:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584119.887817:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584119.888168:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789584119.888175:0:23258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbaadaa3/0x113b6add9f869514 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.891325:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789584119.895136:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789584119.895546:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019cf7408/0x113b6add9f86951b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.895571:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=773s v=(0 0) 00010000:00010000:0.0:1789584119.895577:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584119.895587:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019cf7408/0x113b6add9f86951b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.895610:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019cf7408/0x113b6add9f86951b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.895625:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019cf7408/0x113b6add9f86951b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.895635:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019cf7408/0x113b6add9f86951b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.895669:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789584119.898781:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584119.898801:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019cf7408/0x113b6add9f86951b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.898817:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc0030a00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584119.898824:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019cf7408/0x113b6add9f86951b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.898839:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019cf7408/0x113b6add9f86951b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.898879:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019cf7408/0x113b6add9f86951b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584119.898898:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019cf7408/0x113b6add9f86951b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789584119.898994:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1789584119.899145:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584119.899148:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584119.899150:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789584119.899698:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.899711:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e641c6b1/0x113b6add9f869522 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.899744:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.899750:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.899759:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e641c6b1/0x113b6add9f869522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.899779:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e641c6b1/0x113b6add9f869522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.899793:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e641c6b1/0x113b6add9f869522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.899802:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e641c6b1/0x113b6add9f869522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.899838:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789584119.900480:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.900501:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a730dc4a/0x113b6add9f869529 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.900515:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.900519:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.900525:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a730dc4a/0x113b6add9f869529 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.900542:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a730dc4a/0x113b6add9f869529 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.900564:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a730dc4a/0x113b6add9f869529 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.900572:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a730dc4a/0x113b6add9f869529 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.900587:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789584119.901139:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.901147:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004ab841a/0x113b6add9f869530 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.901158:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.901162:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.901166:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004ab841a/0x113b6add9f869530 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.901178:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004ab841a/0x113b6add9f869530 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.901213:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004ab841a/0x113b6add9f869530 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.901223:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004ab841a/0x113b6add9f869530 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.901247:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789584119.901840:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.901847:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002131e069/0x113b6add9f869537 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.901856:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.901859:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.901863:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002131e069/0x113b6add9f869537 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.901872:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002131e069/0x113b6add9f869537 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.901882:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002131e069/0x113b6add9f869537 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.901890:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002131e069/0x113b6add9f869537 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.901899:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1789584119.907933:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.908701:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9307bb6/0x113b6add9f86953e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.908730:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.908744:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.908753:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9307bb6/0x113b6add9f86953e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.908773:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9307bb6/0x113b6add9f86953e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.908787:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9307bb6/0x113b6add9f86953e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.908797:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9307bb6/0x113b6add9f86953e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.908812:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1789584119.909905:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.909916:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e794b3f1/0x113b6add9f869545 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.909930:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.909934:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.909939:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e794b3f1/0x113b6add9f869545 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.909958:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e794b3f1/0x113b6add9f869545 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.909969:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e794b3f1/0x113b6add9f869545 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.909984:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e794b3f1/0x113b6add9f869545 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.909995:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1789584119.910580:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.910588:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010965ab9/0x113b6add9f86954c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.910599:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.910602:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.910606:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010965ab9/0x113b6add9f86954c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.910617:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010965ab9/0x113b6add9f86954c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.910625:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010965ab9/0x113b6add9f86954c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.910634:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010965ab9/0x113b6add9f86954c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.910643:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1789584119.916218:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.916245:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061890ee6/0x113b6add9f869553 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.917074:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.917082:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.917092:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061890ee6/0x113b6add9f869553 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.917113:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061890ee6/0x113b6add9f869553 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.918118:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061890ee6/0x113b6add9f869553 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.918500:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061890ee6/0x113b6add9f869553 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.918519:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:2.0:1789584119.920242:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1789584119.920259:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e641c6b1/0x113b6add9f869522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.920293:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c60e00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584119.920300:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e641c6b1/0x113b6add9f869522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.920313:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e641c6b1/0x113b6add9f869522 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.920839:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e641c6b1/0x113b6add9f869522 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.920852:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e641c6b1/0x113b6add9f869522 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.920949:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789584119.920955:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a730dc4a/0x113b6add9f869529 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.920963:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c60400 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584119.920968:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a730dc4a/0x113b6add9f869529 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.920977:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a730dc4a/0x113b6add9f869529 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.920990:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a730dc4a/0x113b6add9f869529 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921007:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a730dc4a/0x113b6add9f869529 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921025:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789584119.921030:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004ab841a/0x113b6add9f869530 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921038:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c61400 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584119.921042:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004ab841a/0x113b6add9f869530 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921052:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004ab841a/0x113b6add9f869530 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921229:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004ab841a/0x113b6add9f869530 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921238:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004ab841a/0x113b6add9f869530 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921254:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789584119.921259:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002131e069/0x113b6add9f869537 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921266:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c60800 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584119.921277:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002131e069/0x113b6add9f869537 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921286:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002131e069/0x113b6add9f869537 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921300:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002131e069/0x113b6add9f869537 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921307:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002131e069/0x113b6add9f869537 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921323:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789584119.921393:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9307bb6/0x113b6add9f86953e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921402:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c61800 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584119.921406:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9307bb6/0x113b6add9f86953e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921414:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9307bb6/0x113b6add9f86953e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921426:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9307bb6/0x113b6add9f86953e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921433:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9307bb6/0x113b6add9f86953e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921671:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789584119.921677:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e794b3f1/0x113b6add9f869545 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921685:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c61c00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584119.921688:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e794b3f1/0x113b6add9f869545 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921697:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e794b3f1/0x113b6add9f869545 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921708:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e794b3f1/0x113b6add9f869545 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921716:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e794b3f1/0x113b6add9f869545 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921728:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789584119.921731:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010965ab9/0x113b6add9f86954c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921737:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c61600 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584119.921740:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010965ab9/0x113b6add9f86954c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789584119.921753:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789584119.921760:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010965ab9/0x113b6add9f86954c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.921765:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a262715/0x113b6add9f86955a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921772:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010965ab9/0x113b6add9f86954c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921782:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010965ab9/0x113b6add9f86954c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.921785:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.921796:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789584119.921801:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789584119.921805:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a262715/0x113b6add9f86955a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921806:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061890ee6/0x113b6add9f869553 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.921822:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a262715/0x113b6add9f86955a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.921846:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a262715/0x113b6add9f86955a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.921854:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a262715/0x113b6add9f86955a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.921866:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789584119.921945:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c60600 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584119.921949:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061890ee6/0x113b6add9f869553 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921957:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061890ee6/0x113b6add9f869553 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921968:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061890ee6/0x113b6add9f869553 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.921976:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061890ee6/0x113b6add9f869553 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.922004:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789584119.922007:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a262715/0x113b6add9f86955a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.922014:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c60a00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584119.922017:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a262715/0x113b6add9f86955a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.922025:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a262715/0x113b6add9f86955a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.922035:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a262715/0x113b6add9f86955a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.922042:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a262715/0x113b6add9f86955a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.922053:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584119.922055:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584119.922057:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584119.922145:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789584119.923808:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.923823:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f869561 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.923843:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.923848:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.923855:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f869561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.923871:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f869561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.923881:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f869561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.923890:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f869561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.923931:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789584119.924761:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789584119.924776:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f869561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.924789:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95d400 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:1.0:1789584119.924795:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f869561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.924806:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f869561 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.924832:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f869561 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.924842:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f869561 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.924870:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584119.924872:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584119.924874:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789584119.933151:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.933305:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006acb16f8/0x113b6add9f869568 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.933329:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.933344:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.933353:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006acb16f8/0x113b6add9f869568 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.933381:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006acb16f8/0x113b6add9f869568 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.933394:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006acb16f8/0x113b6add9f869568 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.933403:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006acb16f8/0x113b6add9f869568 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.933433:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789584119.937303:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584119.937322:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006acb16f8/0x113b6add9f869568 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.937340:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95d200 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584119.937346:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006acb16f8/0x113b6add9f869568 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.937361:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006acb16f8/0x113b6add9f869568 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.937391:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006acb16f8/0x113b6add9f869568 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.937400:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006acb16f8/0x113b6add9f869568 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.937426:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584119.937428:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584119.937430:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789584119.938183:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.938212:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000489eb4d9/0x113b6add9f86956f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.938230:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.938236:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.938243:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000489eb4d9/0x113b6add9f86956f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.938260:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000489eb4d9/0x113b6add9f86956f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.938270:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000489eb4d9/0x113b6add9f86956f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.938286:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000489eb4d9/0x113b6add9f86956f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.938310:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789584119.938752:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584119.938762:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000489eb4d9/0x113b6add9f86956f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.938772:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95cc00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584119.938779:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000489eb4d9/0x113b6add9f86956f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.939222:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000489eb4d9/0x113b6add9f86956f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.939246:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000489eb4d9/0x113b6add9f86956f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.939255:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000489eb4d9/0x113b6add9f86956f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.939277:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584119.939279:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584119.939281:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789584119.940784:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.940803:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c21b177/0x113b6add9f869576 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.940825:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.940831:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.940838:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c21b177/0x113b6add9f869576 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.940854:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c21b177/0x113b6add9f869576 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.940872:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c21b177/0x113b6add9f869576 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.940881:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c21b177/0x113b6add9f869576 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.940908:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789584119.941692:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584119.941703:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c21b177/0x113b6add9f869576 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.941717:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95ca00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584119.941723:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c21b177/0x113b6add9f869576 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.941921:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c21b177/0x113b6add9f869576 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.942267:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c21b177/0x113b6add9f869576 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.942297:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c21b177/0x113b6add9f869576 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.942327:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584119.942329:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584119.942331:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789584119.948812:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.948832:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d056336e/0x113b6add9f86957d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.948862:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.948867:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.948875:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d056336e/0x113b6add9f86957d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.948895:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d056336e/0x113b6add9f86957d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.948908:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d056336e/0x113b6add9f86957d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.948917:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d056336e/0x113b6add9f86957d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.948952:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789584119.949036:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584119.949047:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d056336e/0x113b6add9f86957d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.949058:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95d600 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584119.949065:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d056336e/0x113b6add9f86957d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.949076:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d056336e/0x113b6add9f86957d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.949101:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d056336e/0x113b6add9f86957d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.949109:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d056336e/0x113b6add9f86957d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.949134:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584119.949136:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584119.949138:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789584119.949601:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.949609:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b1cc853/0x113b6add9f869584 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.949619:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.949623:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.949628:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b1cc853/0x113b6add9f869584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.949639:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b1cc853/0x113b6add9f869584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.949661:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b1cc853/0x113b6add9f869584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.949670:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b1cc853/0x113b6add9f869584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.949693:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789584119.949741:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584119.949748:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b1cc853/0x113b6add9f869584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.949757:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95da00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584119.949761:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b1cc853/0x113b6add9f869584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.949770:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b1cc853/0x113b6add9f869584 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.949783:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b1cc853/0x113b6add9f869584 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.949802:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b1cc853/0x113b6add9f869584 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.949821:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584119.949824:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584119.949827:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789584119.950167:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.950174:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c904aa0/0x113b6add9f86958b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.950184:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.950211:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.950215:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c904aa0/0x113b6add9f86958b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.950225:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c904aa0/0x113b6add9f86958b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.950234:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c904aa0/0x113b6add9f86958b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.950242:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c904aa0/0x113b6add9f86958b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.950274:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789584119.950784:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.950791:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f014d0e/0x113b6add9f869592 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.950803:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.950806:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.950811:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f014d0e/0x113b6add9f869592 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.950821:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f014d0e/0x113b6add9f869592 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.950830:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f014d0e/0x113b6add9f869592 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.950838:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f014d0e/0x113b6add9f869592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.950862:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789584119.951407:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789584119.951417:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c904aa0/0x113b6add9f86958b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.951428:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95c600 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584119.951444:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c904aa0/0x113b6add9f86958b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.951454:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c904aa0/0x113b6add9f86958b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.951474:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c904aa0/0x113b6add9f86958b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.951483:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c904aa0/0x113b6add9f86958b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.951518:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789584119.951522:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f014d0e/0x113b6add9f869592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.951528:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95d800 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584119.951531:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f014d0e/0x113b6add9f869592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.951539:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f014d0e/0x113b6add9f869592 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.951550:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f014d0e/0x113b6add9f869592 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.951557:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f014d0e/0x113b6add9f869592 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.951582:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584119.951584:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584119.951586:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584119.951656:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789584119.963330:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.963353:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc8598f6/0x113b6add9f869599 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.963377:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.963402:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.963410:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc8598f6/0x113b6add9f869599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.963431:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc8598f6/0x113b6add9f869599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.963444:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc8598f6/0x113b6add9f869599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.963453:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc8598f6/0x113b6add9f869599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.963483:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789584119.963995:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584119.964006:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc8598f6/0x113b6add9f869599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.964018:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95de00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584119.964024:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc8598f6/0x113b6add9f869599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.964055:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc8598f6/0x113b6add9f869599 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.964081:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc8598f6/0x113b6add9f869599 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.964089:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc8598f6/0x113b6add9f869599 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789584119.964106:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.964115:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000985e732f/0x113b6add9f8695a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.964116:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584119.964119:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584119.964123:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584119.964131:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.964136:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.964141:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000985e732f/0x113b6add9f8695a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.964153:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000985e732f/0x113b6add9f8695a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.964163:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000985e732f/0x113b6add9f8695a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.964179:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000985e732f/0x113b6add9f8695a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.964236:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789584119.964718:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.964724:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f8695a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.964735:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.964738:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.964743:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f8695a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.964753:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f8695a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.964762:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f8695a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.964770:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f8695a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.964786:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789584119.964893:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789584119.964901:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000985e732f/0x113b6add9f8695a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.964910:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95c400 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584119.964915:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000985e732f/0x113b6add9f8695a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.964924:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000985e732f/0x113b6add9f8695a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.964941:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000985e732f/0x113b6add9f8695a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.964961:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000985e732f/0x113b6add9f8695a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.964979:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584119.964984:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f8695a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.964991:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95d400 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584119.964995:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f8695a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.965003:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f8695a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.965014:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f8695a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.965021:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000036da306/0x113b6add9f8695a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584119.965035:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584119.965036:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584119.965038:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584119.965634:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789584119.968353:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.968500:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099de1813/0x113b6add9f8695ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.968532:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.968539:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.968547:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099de1813/0x113b6add9f8695ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.968565:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099de1813/0x113b6add9f8695ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.968577:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099de1813/0x113b6add9f8695ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.968586:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099de1813/0x113b6add9f8695ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.968609:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789584119.970695:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.970714:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5b2f5bc/0x113b6add9f8695b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.970733:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.970739:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.970746:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5b2f5bc/0x113b6add9f8695b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.970762:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5b2f5bc/0x113b6add9f8695b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.970788:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5b2f5bc/0x113b6add9f8695b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.970797:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5b2f5bc/0x113b6add9f8695b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.970829:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789584119.971658:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584119.971668:0:23258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c300804/0x113b6add9f8695bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.971681:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1789584119.971684:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584119.971689:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c300804/0x113b6add9f8695bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.971701:0:23258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c300804/0x113b6add9f8695bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.971711:0:23258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c300804/0x113b6add9f8695bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.971720:0:23258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c300804/0x113b6add9f8695bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584119.971743:0:23258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789584119.971892:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789584119.971903:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099de1813/0x113b6add9f8695ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.971915:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95c200 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584119.971921:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099de1813/0x113b6add9f8695ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789584119.971930:0:23258:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00010000:00010000:2.0:1789584119.971933:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099de1813/0x113b6add9f8695ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.971958:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099de1813/0x113b6add9f8695ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.971966:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099de1813/0x113b6add9f8695ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.971989:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789584119.971993:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5b2f5bc/0x113b6add9f8695b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.971999:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95d000 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584119.972010:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5b2f5bc/0x113b6add9f8695b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.972018:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5b2f5bc/0x113b6add9f8695b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.972028:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5b2f5bc/0x113b6add9f8695b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.972035:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5b2f5bc/0x113b6add9f8695b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.972049:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789584119.972052:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c300804/0x113b6add9f8695bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.972058:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95c800 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584119.972061:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c300804/0x113b6add9f8695bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.972068:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c300804/0x113b6add9f8695bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.972077:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c300804/0x113b6add9f8695bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.972083:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c300804/0x113b6add9f8695bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584119.972102:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584119.972104:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584119.972106:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789584119.972483:0:23258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:21970:x1876514253845120:12345-0@lo:5:osp-pre-0-0.0 Request processed in 172308us (172582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584119.972506:0:23258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789584119.972585:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789584119.973249:0:21970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21970:1876514253845120:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789584119.973272:0:21970:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:2.0:1789584119.973341:0:21970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21970:1876514253845248:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789584119.973393:0:21970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584119.973434:0:21970:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8de06bf180 going to sleep for 11 seconds 00000100:00100000:1.0:1789584119.973454:0:23257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253845248 00000100:00100000:1.0:1789584119.973464:0:23257:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253845248 00000100:00100000:1.0:1789584119.973530:0:23257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789584119.973544:0:23257:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:21970:x1876514253845248:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789584119.973601:0:23257:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:3.0:1789584119.973805:0:8131:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000100:00100000:1.0:1789584119.989685:0:23257:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:21970:x1876514253845248:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16129us (16275us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1789584119.989706:0:23257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789584119.990838:0:21970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21970:1876514253845248:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789584119.990866:0:21970:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000020:01000004:2.0:1789584120.155506:0:23978:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789584120.155512:0:23978:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789584120.155651:0:23978:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f8ded947000 00000020:01000004:2.0:1789584120.155674:0:23978:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789584120.155694:0:23978:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789584120.155712:0:23978:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f8de8073380) 00000020:00000080:2.0:1789584120.155735:0:23978:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789584120.195166:0:23978:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789584120.196037:0:23978:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789584120.197840:0:23978:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789584120.198238:0:23978:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789584120.202463:0:23978:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:1.0:1789584120.205413:0:23978:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 441: rc = 0 00100000:10000000:1.0:1789584120.205696:0:23978:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 441: rc = 0 00100000:10000000:1.0:1789584120.205876:0:23978:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 441: rc = 0 00100000:10000000:1.0:1789584120.208059:0:23978:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 219: rc = 0 00100000:10000000:1.0:1789584120.210846:0:23978:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 219: rc = 0 00100000:10000000:1.0:1789584120.211252:0:23978:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 219: rc = 0 00100000:10000000:1.0:1789584120.211532:0:23978:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 219: rc = 0 00100000:10000000:1.0:1789584120.211816:0:23978:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 219: rc = 0 00100000:10000000:1.0:1789584120.212094:0:23978:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 219: rc = 0 00000020:00000080:1.0:1789584120.212910:0:23978:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789584120.212935:0:23978:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789584120.212951:0:23978:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x113b6add9f8695ca 00000020:01000004:1.0:1789584120.212962:0:23978:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1789584120.212990:0:23978:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.111@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789584120.212995:0:23978:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789584120.213002:0:23978:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789584120.213031:0:23978:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1789584120.213037:0:23978:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789584120.250575:0:23978:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789584120.250656:0:23978:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.111@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789584120.250670:0:23978:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789584120.250671:0:23978:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789584120.250673:0:23978:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789584120.250674:0:23978:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789584120.250675:0:23978:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789584120.250677:0:23978:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789584120.250678:0:23978:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789584120.250681:0:23978:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789584120.250682:0:23978:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789584120.250688:0:23978:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789584120.250691:0:23978:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789584120.250692:0:23978:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789584120.250693:0:23978:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789584120.250693:0:23978:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789584120.250694:0:23978:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789584120.250695:0:23978:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789584120.250696:0:23978:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789584120.250697:0:23978:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789584120.250698:0:23978:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789584120.251916:0:23978:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789584120.252162:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253845376:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789584120.252702:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584120.253830:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc12ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584120.254074:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253845376 00000100:00100000:3.0:1789584120.254370:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253845376 00000100:00100000:3.0:1789584120.254512:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789584120.254526:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23978:x1876514253845376:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789584120.254581:0:21938:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789584120.254585:0:21938:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789584120.254590:0:21938:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789584120.288652:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253845504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789584120.292827:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584120.293445:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789584120.293464:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253845632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789584120.293626:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584120.293761:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253845504 00000100:00100000:3.0:1789584120.293775:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253845504 00000100:00100000:3.0:1789584120.293855:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253845632 00000100:00100000:3.0:1789584120.293859:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253845632 00000100:00100000:3.0:1789584120.293880:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789584120.293891:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253845504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789584120.293959:0:21951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789584120.294026:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253845504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584120.294052:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789584120.294072:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789584120.294077:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253845632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789584120.294101:0:21951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789584120.294128:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253845632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584120.294134:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789584120.296102:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253845632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789584120.296137:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253845504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789584120.299422:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23978:x1876514253845376:12345-0@lo:253:mount.lustre.0 Request processed in 44884us (46706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584120.299454:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789584120.301060:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253845376:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789584120.301088:0:23978:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789584120.301093:0:23978:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789584120.301095:0:23978:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789584120.301097:0:23978:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789584120.301098:0:23978:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789584120.301100:0:23978:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789584120.301101:0:23978:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789584120.301103:0:23978:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789584120.301105:0:23978:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789584120.301106:0:23978:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789584120.301163:0:23978:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f8ded947000 from lustre-OST0001 10000000:01000000:1.0:1789584120.301241:0:23978:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789584120.301245:0:23978:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789584120.301257:0:23978:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f8de091b380 local copy 00010000:00010000:1.0:1789584120.301287:0:23978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86920b expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584120.302110:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253845760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584120.302308:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584120.302363:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dfd348180 going to sleep for 11 seconds 00000100:00100000:2.0:1789584120.304370:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253845760 00000100:00100000:2.0:1789584120.304392:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253845760 00000100:00100000:2.0:1789584120.304506:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789584120.304520:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23978:x1876514253845760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789584120.305375:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23978:x1876514253845760:12345-0@lo:501:mount.lustre.0 Request processed in 853us (3061us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789584120.305404:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789584120.305607:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253845760:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789584120.305642:0:23978:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789584120.305876:0:23978:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789584120.305889:0:23978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86920b expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584120.305902:0:23978:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0400/0x113b6add9f869204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86920b expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789584120.306687:0:23978:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8ded947000 10000000:01000000:3.0:1789584120.306699:0:23978:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789584120.306710:0:23978:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789584120.306723:0:23978:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789584120.306730:0:23978:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789584120.306735:0:23978:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789584120.306790:0:23978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9e00/0x113b6add9f8695d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584120.306814:0:23978:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9e00/0x113b6add9f8695d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584120.306829:0:23978:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9e00/0x113b6add9f8695d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584120.306865:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253845888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789584120.308176:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584120.308266:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc6fcb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789584120.308567:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253845888 00000100:00100000:2.0:1789584120.308581:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253845888 00000100:00100000:2.0:1789584120.308651:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789584120.308663:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:23978:x1876514253845888:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789584120.308683:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584120.308709:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8e02046000/0x113b6add9f8695d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f8695d1 expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.310057:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8e02046000/0x113b6add9f8695d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f8695d1 expref: 22 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.310075:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8e02046000/0x113b6add9f8695d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8695d1 expref: 22 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.310086:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8e02046000, rc 0) 00000100:00100000:2.0:1789584120.310238:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:23978:x1876514253845888:12345-0@lo:101:mount.lustre.0 Request processed in 1577us (2126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584120.310249:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789584120.311965:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253845888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789584120.312007:0:23978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9e00/0x113b6add9f8695d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8695d8 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584120.312023:0:23978:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9e00/0x113b6add9f8695d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f8695d8 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789584120.312961:0:23978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1789584120.314054:0:23978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789584120.314386:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789584120.314435:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789584120.314469:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789584120.314559:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789584120.314599:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789584120.314636:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789584120.319760:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789584120.319922:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789584120.319995:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1789584120.320095:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1789584120.320622:0:23978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1789584120.320847:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789584120.320935:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584120.321063:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc2e7d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789584120.321798:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253846016 00000100:00100000:2.0:1789584120.321809:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253846016 00000100:00100000:2.0:1789584120.321891:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789584120.321903:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:23978:x1876514253846016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789584120.323822:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:23978:x1876514253846016:12345-0@lo:501:mount.lustre.0 Request processed in 1911us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584120.323837:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789584120.324138:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789584120.324234:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846144:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789584120.324297:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584120.324345:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc2e7d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789584120.324418:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253846144 00000100:00100000:1.0:1789584120.324427:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253846144 00000100:00100000:1.0:1789584120.324540:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789584120.324551:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:23978:x1876514253846144:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789584120.325322:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:23978:x1876514253846144:12345-0@lo:503:mount.lustre.0 Request processed in 768us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584120.325334:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789584120.325491:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846144:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789584120.328861:0:23978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789584120.329020:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789584120.329151:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584120.329781:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8de06bf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584120.329914:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253846272 00000100:00100000:3.0:1789584120.329925:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253846272 00000100:00100000:3.0:1789584120.329998:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789584120.330137:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:23978:x1876514253846272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789584120.331104:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:23978:x1876514253846272:12345-0@lo:502:mount.lustre.0 Request processed in 966us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584120.331273:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789584120.332111:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789584120.332224:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789584120.332258:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789584120.332304:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789584120.332340:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789584120.332407:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789584120.332589:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789584120.332632:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789584120.332685:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1789584120.332828:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789584120.332929:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584120.332980:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8de06bf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789584120.333238:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253846400 00000100:00100000:1.0:1789584120.333249:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253846400 00000100:00100000:3.0:1789584120.338880:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789584120.340103:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789584120.340377:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:23978:x1876514253846400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584120.341610:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:23978:x1876514253846400:12345-0@lo:502:mount.lustre.0 Request processed in 1483us (8672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584120.341628:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789584120.344135:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789584120.346160:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1789584120.346299:0:23978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1789584120.349283:0:23980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789584120.349301:0:23980:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789584120.349310:0:23980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789584120.349313:0:23980:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789584120.349323:0:23980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789584120.349349:0:23980:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f8e009d0000) 00000020:00000080:0.0:1789584120.349387:0:23980:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789584120.349394:0:23980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789584120.349514:0:23980:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8ded947000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789584120.349526:0:23980:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789584120.349535:0:23980:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x113b6add9f8695e6 00010000:00010000:2.0:1789584120.365929:0:23980:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789584120.368277:0:23980:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1789584120.381583:0:23980:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1789584120.392039:0:23980:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789584120.392060:0:23980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789584120.392069:0:23980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584120.392072:0:23980:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789584120.392075:0:23980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789584120.392081:0:23980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584120.392082:0:23980:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789584120.392085:0:23980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789584120.392087:0:23980:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789584120.392089:0:23980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789584120.392091:0:23980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584120.392100:0:23980:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789584120.392104:0:23980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789584120.392106:0:23980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584120.392108:0:23980:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789584120.392112:0:23980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789584120.392259:0:23980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789584120.392263:0:23980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789584120.392265:0:23980:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789584120.392269:0:23980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1789584120.392599:0:23978:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789584120.392646:0:23978:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789584120.392687:0:23978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9e00/0x113b6add9f8695d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8695d8 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584120.392701:0:23978:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9e00/0x113b6add9f8695d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8695d8 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789584120.392717:0:23978:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8ded947000 from 1 10000000:01000000:0.0:1789584120.392720:0:23978:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789584120.392772:0:23978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8695ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584120.392780:0:23978:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8695ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584120.392794:0:23978:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8695ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584120.392826:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789584120.392924:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584120.392982:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253846528 00000100:00100000:0.0:1789584120.392992:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253846528 00000100:00100000:0.0:1789584120.393049:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789584120.393061:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dda102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:23978:x1876514253846528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789584120.393081:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789584120.393097:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8dc0031200/0x113b6add9f8695f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f8695ed expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584120.393130:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8dc0031200/0x113b6add9f8695f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f8695ed expref: 23 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584120.393156:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8dc0031200/0x113b6add9f8695f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8695ed expref: 23 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584120.393167:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8dc0031200, rc 0) 00000100:00100000:0.0:1789584120.393236:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dda102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:23978:x1876514253846528:12345-0@lo:101:mount.lustre.0 Request processed in 177us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584120.393245:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789584120.393306:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc907cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789584120.393336:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846528:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789584120.393354:0:23978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8695ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8695f4 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584120.393363:0:23978:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8695ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f8695f4 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789584120.394118:0:23978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1789584120.394972:0:23978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789584120.395317:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789584120.395369:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789584120.407907:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789584120.408075:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789584120.408119:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789584120.408271:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789584120.408311:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789584120.408361:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1789584120.408414:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1789584120.408812:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1789584120.408859:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1789584120.409072:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1789584120.409082:0:23978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1789584120.409877:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789584120.410043:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584120.410880:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc907cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789584120.414493:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253846656 00000100:00100000:1.0:1789584120.414520:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253846656 00000100:00100000:1.0:1789584120.414603:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789584120.414618:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:23978:x1876514253846656:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789584120.415431:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:23978:x1876514253846656:12345-0@lo:501:mount.lustre.0 Request processed in 812us (5393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584120.415454:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789584120.418883:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789584120.422707:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789584120.422847:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584120.422898:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8de06abb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789584120.424093:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253846784 00000100:00100000:0.0:1789584120.424109:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253846784 00000100:00100000:0.0:1789584120.424228:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789584120.424242:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:23978:x1876514253846784:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789584120.424975:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:23978:x1876514253846784:12345-0@lo:503:mount.lustre.0 Request processed in 731us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584120.424989:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789584120.426173:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846784:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789584120.427267:0:23978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789584120.427395:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846912:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789584120.427523:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584120.427584:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc2e7db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789584120.428262:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253846912 00000100:00100000:1.0:1789584120.428276:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253846912 00000100:00100000:1.0:1789584120.428349:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789584120.428362:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:23978:x1876514253846912:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584120.428889:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:23978:x1876514253846912:12345-0@lo:502:mount.lustre.0 Request processed in 528us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584120.428900:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789584120.429682:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253846912:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789584120.430280:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789584120.430353:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789584120.430406:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789584120.430628:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789584120.430669:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789584120.430802:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789584120.430845:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789584120.430884:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1789584120.431071:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1789584120.431264:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1789584120.432844:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1789584120.432932:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253847040:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789584120.433585:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584120.433648:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc2e7db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789584120.433740:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253847040 00000100:00100000:1.0:1789584120.433752:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253847040 00000100:00100000:1.0:1789584120.433829:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789584120.433841:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:23978:x1876514253847040:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789584120.434181:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:23978:x1876514253847040:12345-0@lo:502:mount.lustre.0 Request processed in 341us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584120.434234:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789584120.434635:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253847040:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789584120.434843:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1789584120.434862:0:23978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789584120.436696:0:23984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789584120.436722:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584120.436725:0:23984:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789584120.436741:0:23984:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8ded947000 00000020:00000080:1.0:1789584120.436747:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789584120.436760:0:23984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789584120.436763:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584120.436764:0:23984:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789584120.436767:0:23984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789584120.436769:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584120.436770:0:23984:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789584120.436774:0:23984:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8ded947000 00000020:00000080:1.0:1789584120.436776:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789584120.436890:0:23984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789584120.436893:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584120.436895:0:23984:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789584120.436905:0:23984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789584120.436908:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584120.436909:0:23984:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789584120.436913:0:23984:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8ded947000 00000020:00000080:1.0:1789584120.436915:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789584120.439576:0:23984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789584120.439596:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584120.439599:0:23984:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789584120.439614:0:23984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789584120.439620:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584120.439621:0:23984:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789584120.439627:0:23984:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f8ded947000 00000020:00000080:1.0:1789584120.439630:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789584120.439791:0:23984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789584120.439795:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789584120.439797:0:23984:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789584120.439801:0:23984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1789584120.442698:0:23978:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789584120.442774:0:23978:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789584120.442801:0:23978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8695ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8695f4 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584120.442817:0:23978:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8695ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f8695f4 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789584120.442903:0:23978:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789584120.442906:0:23978:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8ded947000 10000000:01000000:3.0:1789584120.442910:0:23978:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8ded947000 10000000:01000000:3.0:1789584120.442915:0:23978:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789584120.442922:0:23978:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8ded947000 from 1 10000000:01000000:3.0:1789584120.442925:0:23978:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789584120.443112:0:23978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8c00/0x113b6add9f8695fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584120.443216:0:23978:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8c00/0x113b6add9f8695fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584120.443230:0:23978:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8c00/0x113b6add9f8695fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584120.443263:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253847168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789584120.443360:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584120.443409:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc2e7d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789584120.443814:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253847168 00000100:00100000:2.0:1789584120.443843:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253847168 00000100:00100000:2.0:1789584120.445421:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789584120.445457:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:23978:x1876514253847168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789584120.445491:0:21939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584120.445518:0:21939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8e02046e00/0x113b6add9f869602 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f8695fb expref: -99 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.445562:0:21939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8e02046e00/0x113b6add9f869602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f8695fb expref: 24 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.445575:0:21939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8e02046e00/0x113b6add9f869602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8695fb expref: 24 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.445585:0:21939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8e02046e00, rc 0) 00000100:00100000:2.0:1789584120.445682:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:23978:x1876514253847168:12345-0@lo:101:mount.lustre.0 Request processed in 246us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584120.445689:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789584120.459666:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253847168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789584120.459794:0:23978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8c00/0x113b6add9f8695fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869602 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584120.459813:0:23978:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8c00/0x113b6add9f8695fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f869602 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789584120.468379:0:23978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00010000:00010000:2.0:1789584120.476987:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789584120.480401:0:23978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789584120.480894:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789584120.480950:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1789584120.480986:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1789584120.481054:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1789584120.481093:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1789584120.481142:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1789584120.481175:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1789584120.481552:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1789584120.481629:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789584120.481668:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1789584120.481703:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1789584120.481859:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1789584120.481897:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1789584120.481933:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1789584120.481982:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1789584120.482016:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1789584120.482052:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1789584120.482105:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1789584120.482144:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1789584120.482178:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1789584120.485420:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1789584120.485864:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1789584120.485897:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1789584120.486401:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1789584120.486551:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1789584120.486593:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1789584120.486650:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1789584120.486708:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1789584120.487383:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1789584120.493542:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1789584120.493701:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1789584120.493760:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1789584120.493798:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1789584120.493875:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1789584120.493911:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1789584120.493974:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1789584120.494010:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1789584120.494040:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1789584120.494083:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1789584120.494119:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1789584120.494155:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1789584120.494232:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1789584120.494291:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1789584120.494360:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1789584120.494394:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1789584120.494445:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1789584120.494493:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1789584120.494529:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1789584120.494643:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1789584120.494678:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1789584120.494742:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1789584120.494751:0:23978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1789584120.494914:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253847296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789584120.495014:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584120.495083:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc2e7d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789584120.495900:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253847296 00000100:00100000:2.0:1789584120.495912:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253847296 00000100:00100000:2.0:1789584120.495998:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789584120.496011:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:23978:x1876514253847296:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789584120.496410:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:23978:x1876514253847296:12345-0@lo:501:mount.lustre.0 Request processed in 399us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584120.496420:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789584120.497642:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253847296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789584120.497802:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253847424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789584120.497887:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584120.497923:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc2e7d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789584120.498048:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253847424 00000100:00100000:2.0:1789584120.498057:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253847424 00000100:00100000:2.0:1789584120.498110:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789584120.498121:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:23978:x1876514253847424:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789584120.511164:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:23978:x1876514253847424:12345-0@lo:503:mount.lustre.0 Request processed in 13020us (13252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584120.511211:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789584120.513355:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253847424:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789584120.514466:0:23978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789584120.514622:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253847552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789584120.514748:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584120.514812:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc6b7d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789584120.514849:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253847552 00000100:00100000:2.0:1789584120.514857:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253847552 00000100:00100000:2.0:1789584120.514916:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789584120.514927:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:23978:x1876514253847552:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789584120.515335:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:23978:x1876514253847552:12345-0@lo:502:mount.lustre.0 Request processed in 408us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584120.515346:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789584120.515428:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253847552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789584120.515709:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789584120.515769:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1789584120.515807:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1789584120.515879:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1789584120.515917:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1789584120.515965:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1789584120.516000:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1789584120.516030:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1789584120.516073:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789584120.524708:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1789584120.525179:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1789584120.526054:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1789584120.526127:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1789584120.526165:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1789584120.528656:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1789584120.528877:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1789584120.528908:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1789584120.529026:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1789584120.529064:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1789584120.529134:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1789584120.529296:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1789584120.529331:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1789584120.529356:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1789584120.529394:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1789584120.529424:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1789584120.531172:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1789584120.532419:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1789584120.532736:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1789584120.532780:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1789584120.532848:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1789584120.532890:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1789584120.532923:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1789584120.532975:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1789584120.533028:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1789584120.533065:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1789584120.533153:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1789584120.533233:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1789584120.533274:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1789584120.533326:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1789584120.533364:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1789584120.533394:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1789584120.533424:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1789584120.533500:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1789584120.535807:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1789584120.536025:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1789584120.536128:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1789584120.536532:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1789584120.537104:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1789584120.537850:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253847680:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789584120.538863:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584120.539012:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253847680 00000100:00100000:2.0:1789584120.539024:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253847680 00000100:00100000:2.0:1789584120.539089:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789584120.539100:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:23978:x1876514253847680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789584120.542842:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:23978:x1876514253847680:12345-0@lo:502:mount.lustre.0 Request processed in 2608us (2852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584120.542864:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789584120.543355:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc6b7d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789584120.543402:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253847680:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789584120.545054:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1789584120.545139:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1789584120.545236:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253847808:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789584120.545343:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584120.545402:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc6b7d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584120.547150:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253847808 00000100:00100000:3.0:1789584120.547172:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253847808 00000100:00100000:3.0:1789584120.547872:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789584120.547889:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:23978:x1876514253847808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789584120.551179:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:23978:x1876514253847808:12345-0@lo:502:mount.lustre.0 Request processed in 3278us (5820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584120.551433:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253847808:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789584120.552365:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000040:00080000:1.0:1789584120.554145:0:23978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1789584120.554181:0:23978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789584120.568965:0:23989:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789584120.568991:0:23989:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f8cc5ccb380) 00000020:00000080:3.0:1789584120.569026:0:23989:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789584120.569165:0:23989:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8ded947000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789584120.569171:0:23989:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8ded947000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789584120.569174:0:23989:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8ded947000 3 00010000:00080000:3.0:1789584120.569457:0:23989:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8cc4fb3800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.111@tcp at head 00010000:00010000:1.0:1789584120.585984:0:23989:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1789584120.586281:0:23989:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789584120.586338:0:23989:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789584120.586355:0:23989:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x113b6add9f869610 00000100:00080000:1.0:1789584120.586371:0:23989:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789584120.586387:0:23989:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f8cc4fb3800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1789584120.586439:0:23989:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8df4fa1180 x1876514253847936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789584120.586502:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3453:1876514253847936:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789584120.586605:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584120.586706:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253847936 00000100:00080000:0.0:1789584120.587163:0:23989:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789584120.589783:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253847936 00000100:00100000:1.0:1789584120.589877:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789584120.589888:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3453:x1876514253847936:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789584120.589927:0:21947:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 773 last 0 00000020:00000080:1.0:1789584120.589997:0:21947:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x113b6add9f869617 00000004:00100000:1.0:1789584120.590020:0:21947:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789584120.590071:0:21947:0:(import.c:65:import_set_state_nolock()) ffff8f8de05d9000 : changing import state from RECOVER to FULL 00000020:01000004:0.0:1789584120.593149:0:23989:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789584120.593178:0:23989:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8f8e009d19c0) 00000020:00000080:0.0:1789584120.593239:0:23989:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1789584120.593347:0:23989:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8ded947000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789584120.593352:0:23989:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8ded947000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789584120.593355:0:23989:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8ded947000 3 00010000:00080000:0.0:1789584120.593394:0:23989:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8ded9e6000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.111@tcp at head 00000100:00100000:1.0:1789584120.594899:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3453:x1876514253847936:12345-0@lo:38:llog_process_th.0 Request processed in 301us (3584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584120.594920:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789584120.595243:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8df4fa1180 x1876514253847936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789584130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584120.595258:0:3453:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789584120.595272:0:3453:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1789584120.595284:0:3453:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789584120.595291:0:3453:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789584120.595300:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4fb3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789584120.595311:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3453:1876514253847936:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1789584120.604103:0:23989:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1789584120.609175:0:23989:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789584120.611895:0:23989:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789584120.611929:0:23989:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x113b6add9f869625 00000100:00080000:3.0:1789584120.613326:0:23989:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789584120.613343:0:23989:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8f8ded9e6000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1789584120.613400:0:23989:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8dc4c5c380 x1876514253848064/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789584120.613435:0:23989:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789584120.615107:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3453:1876514253848064:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789584120.616068:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584120.616855:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253848064 00000100:00100000:1.0:1789584120.616869:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253848064 00000100:00100000:1.0:1789584120.616928:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789584120.619663:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3453:x1876514253848064:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789584120.619716:0:21945:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 773 last 0 00000020:00000080:1.0:1789584120.619819:0:21945:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x113b6add9f86962c 00000004:00100000:1.0:1789584120.619843:0:21945:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789584120.619891:0:21945:0:(import.c:65:import_set_state_nolock()) ffff8f8cc6ca8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789584120.620027:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3453:x1876514253848064:12345-0@lo:38:llog_process_th.0 Request processed in 381us (3960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584120.620038:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789584120.623856:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dc4c5c380 x1876514253848064/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789584130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584120.623876:0:3453:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789584120.623891:0:3453:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1789584120.623904:0:3453:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789584120.623912:0:3453:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789584120.623946:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8ded9e6000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789584120.623956:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3453:1876514253848064:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789584120.632423:0:23989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1789584120.634637:0:23978:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789584120.634698:0:23978:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789584120.635024:0:23978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8c00/0x113b6add9f8695fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869602 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584120.635041:0:23978:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8c00/0x113b6add9f8695fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869602 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789584120.635123:0:23978:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789584120.635126:0:23978:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789584120.635127:0:23978:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789584120.635129:0:23978:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789584120.635130:0:23978:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789584120.635132:0:23978:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789584120.635134:0:23978:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789584120.635136:0:23978:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789584120.635137:0:23978:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789584120.635142:0:23978:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789584120.635145:0:23978:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789584120.635147:0:23978:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789584120.635148:0:23978:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789584120.635149:0:23978:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789584120.635150:0:23978:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789584120.635151:0:23978:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789584120.635152:0:23978:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789584120.635153:0:23978:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789584120.635154:0:23978:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789584120.635656:0:23978:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789584120.635692:0:23978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253848192:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789584120.636112:0:23978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584120.636173:0:23978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dfd348600 going to sleep for 11 seconds 00000100:00100000:3.0:1789584120.636880:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253848192 00000100:00100000:3.0:1789584120.636892:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253848192 00000100:00100000:3.0:1789584120.638318:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789584120.638341:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:23978:x1876514253848192:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789584120.638389:0:21938:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789584120.638409:0:21938:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789584120.700416:0:21938:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789584120.700440:0:21938:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789584120.701559:0:21961:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789584120.701571:0:21961:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789584120.701605:0:21961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8df4fe8800/0x113b6add9f869633 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584120.701629:0:21961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8df4fe9600/0x113b6add9f8694c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8694c0 expref: 24 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584120.701637:0:21961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8df4fe8000/0x113b6add9f8694d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8694ce expref: 24 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584120.701645:0:21961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8df4fe8800/0x113b6add9f869633 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584120.701700:0:21961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8df4fe8000/0x113b6add9f8694d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x113b6add9f8694ce expref: 24 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584120.701729:0:21961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8df4fe8000/0x113b6add9f8694d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x113b6add9f8694ce expref: 24 pid: 21938 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584120.701748:0:21961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21961:1876514253848320:0@lo:104: 00000100:00100000:3.0:1789584120.701838:0:21961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789584120.701903:0:21961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8df4fe9600/0x113b6add9f8694c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x113b6add9f8694c0 expref: 24 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584120.701945:0:21961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8df4fe9600/0x113b6add9f8694c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x113b6add9f8694c0 expref: 24 pid: 21938 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584120.701954:0:21961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21961:1876514253848448:0@lo:104: 00000100:00100000:3.0:1789584120.701977:0:21961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584120.702004:0:21961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dfd348180 going to sleep for 11 seconds 00000100:00100000:1.0:1789584120.702241:0:21929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253848320 00000100:00100000:1.0:1789584120.702251:0:21929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253848320 00000100:00100000:1.0:1789584120.702299:0:21929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253848448 00000100:00100000:1.0:1789584120.702301:0:21929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253848448 00000100:00100000:1.0:1789584120.702316:0:21929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789584120.702327:0:21929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+4:21961:x1876514253848320:12345-0@lo:104: 00010000:00010000:1.0:1789584120.702343:0:21929:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030400/0x113b6add9f8694ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8694d5 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584120.702404:0:21929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789584120.702409:0:21929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+4:21961:x1876514253848320:12345-0@lo:104: Request processed in 84us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584120.702416:0:21929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789584120.702434:0:21929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789584120.702695:0:21929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+3:21961:x1876514253848448:12345-0@lo:104: 00010000:00010000:1.0:1789584120.702715:0:21929:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff8f8e02046600/0x113b6add9f8694c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8694c7 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584120.702756:0:21929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789584120.702762:0:21929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+3:21961:x1876514253848448:12345-0@lo:104: Request processed in 72us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584120.702768:0:21929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789584120.702790:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789584120.702798:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030400/0x113b6add9f8694ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8694d5 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584120.702824:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc0030400 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:1.0:1789584120.702829:0:21933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030400/0x113b6add9f8694ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x113b6add9f8694d5 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584120.702838:0:21933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030400/0x113b6add9f8694ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x113b6add9f8694d5 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789584120.702846:0:21933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030400/0x113b6add9f8694ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x113b6add9f8694d5 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584120.702853:0:21933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789584120.702895:0:21933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030400/0x113b6add9f8694ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8694d5 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584120.702902:0:21933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789584120.702924:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030400/0x113b6add9f8694ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8694d5 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584120.706122:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8dc0030400/0x113b6add9f8694ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8694d5 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584120.706173:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789584120.706179:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8e02046600/0x113b6add9f8694c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8694c7 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584120.706250:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8e02046600 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:1.0:1789584120.706256:0:21933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8e02046600/0x113b6add9f8694c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x113b6add9f8694c7 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584120.706301:0:21933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8e02046600/0x113b6add9f8694c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x113b6add9f8694c7 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789584120.706310:0:21933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8e02046600/0x113b6add9f8694c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x113b6add9f8694c7 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584120.706317:0:21933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789584120.706375:0:21933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8e02046600/0x113b6add9f8694c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8694c7 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584120.706383:0:21933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789584120.706405:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8e02046600/0x113b6add9f8694c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8694c7 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584120.706414:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8e02046600/0x113b6add9f8694c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8694c7 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584120.706434:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584120.706575:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584120.706578:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789584120.706632:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3456:1876514253848576:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789584120.706844:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789584120.706858:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3457:1876514253848704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789584120.706909:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584120.707017:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253848704 00000100:00100000:2.0:1789584120.707027:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253848704 00010000:00010000:2.0:1789584120.707071:0:21930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8df4fe9600/0x113b6add9f8694c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8694c0 expref: 25 pid: 21938 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584120.707115:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789584120.707126:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+25:3457:x1876514253848704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789584120.707143:0:21930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789584120.707149:0:21930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8df4fe9600/0x113b6add9f8694c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8694c0 expref: 25 pid: 21938 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.707161:0:21930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8df4fe9600/0x113b6add9f8694c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x113b6add9f8694c0 expref: 25 pid: 21938 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.707184:0:21930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789584120.707265:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+25:3457:x1876514253848704:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584120.707273:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789584120.707328:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3457:1876514253848704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789584120.707647:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584120.708067:0:21961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21961:1876514253848320:0@lo:104: 00010000:00010000:3.0:1789584120.708083:0:21961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df4fe9600/0x113b6add9f8694c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x113b6add9f8694c0 expref: 24 pid: 21938 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584120.708099:0:21961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21961:1876514253848448:0@lo:104: 00010000:00010000:3.0:1789584120.708129:0:21961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8df4fe8800/0x113b6add9f869633 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584120.709409:0:21983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253848576 00000100:00100000:2.0:1789584120.709425:0:21983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253848576 00010000:00010000:2.0:1789584120.709515:0:21983:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8df4fe8000/0x113b6add9f8694d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8694ce expref: 24 pid: 21938 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584120.709573:0:21983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789584120.709587:0:21983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:3456:x1876514253848576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789584120.709604:0:21983:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789584120.709610:0:21983:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8df4fe8000/0x113b6add9f8694d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8694ce expref: 24 pid: 21938 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.709623:0:21983:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8df4fe8000/0x113b6add9f8694d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x113b6add9f8694ce expref: 24 pid: 21938 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.709642:0:21983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df4fe8000/0x113b6add9f8694d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x113b6add9f8694ce expref: 24 pid: 21938 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.709661:0:21983:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8df4fe8800/0x113b6add9f869633 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.709672:0:21983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8df4fe8800/0x113b6add9f869633 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789584120.709693:0:21983:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008123581s 00010000:00010000:2.0:1789584120.709698:0:21983:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8df4fe8800/0x113b6add9f869633 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.709717:0:21983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8df4fe8800/0x113b6add9f869633 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.709725:0:21983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8df4fe8800/0x113b6add9f869633 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.709733:0:21983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8df4fe8800/0x113b6add9f869633 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.709748:0:21983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8800 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584120.709753:0:21983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8df4fe8800/0x113b6add9f869633 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.709763:0:21983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8df4fe8800/0x113b6add9f869633 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.709784:0:21983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8df4fe8800/0x113b6add9f869633 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.709795:0:21983:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789584120.709884:0:21983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:3456:x1876514253848576:12345-0@lo:103:ldlm_bl.0 Request processed in 301us (2238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584120.709893:0:21983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789584120.709927:0:21961:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8df4fe8800/0x113b6add9f869633 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.709945:0:21961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8df4fe8800/0x113b6add9f869633 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584120.709953:0:21961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8df4fe8800/0x113b6add9f869633 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584120.710003:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3456:1876514253848576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789584120.721346:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:23978:x1876514253848192:12345-0@lo:253:mount.lustre.0 Request processed in 82998us (85220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584120.721367:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789584120.721601:0:23978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:23978:1876514253848192:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789584120.721624:0:23978:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789584120.721628:0:23978:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789584120.721631:0:23978:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789584120.721633:0:23978:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789584120.721634:0:23978:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789584120.721636:0:23978:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789584120.721660:0:23978:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789584120.721662:0:23978:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789584120.721663:0:23978:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789584120.721665:0:23978:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789584120.721689:0:23978:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789584120.722671:0:23978:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789584120.723040:0:23978:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789584120.723589:0:23978:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789584120.723849:0:23978:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789584120.724070:0:23978:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789584120.724366:0:23978:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789584120.726835:0:23978:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1789584120.881717:0:23978:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789584120.881731:0:23978:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789584120.881780:0:23978:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789584120.881865:0:23978:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789584120.881891:0:23978:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789584120.882085:0:23978:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000040:00080000:2.0:1789584121.057508:0:22601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789584121.499531:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789584122.011307:0:21942:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789584122.011320:0:21942:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8def4be000 from 14 10000000:01000000:1.0:1789584122.011327:0:21942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789584122.011394:0:21942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8ded95c000/0x113b6add9f86963a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584122.011410:0:21942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8ded95c000/0x113b6add9f86963a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584122.011426:0:21942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8ded95c000/0x113b6add9f86963a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584122.011471:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253848832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789584122.011571:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584122.011627:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc8368cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584122.012323:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253848832 00000100:00100000:3.0:1789584122.012334:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253848832 00000100:00100000:3.0:1789584122.012401:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789584122.012414:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:21942:x1876514253848832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789584122.012431:0:21937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789584122.012464:0:21937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8df4fe9600/0x113b6add9f869641 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f86963a expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584122.012495:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8df4fe9600/0x113b6add9f869641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f86963a expref: 23 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584122.012526:0:21937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8df4fe9600/0x113b6add9f869641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f86963a expref: 23 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584122.012537:0:21937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8df4fe9600, rc 0) 00000100:00100000:3.0:1789584122.012993:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:21942:x1876514253848832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 581us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584122.013002:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789584122.019001:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253848832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789584122.019054:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8ded95c000/0x113b6add9f86963a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869641 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584122.019097:0:21942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8ded95c000/0x113b6add9f86963a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f869641 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584122.019220:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253848960:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789584122.019321:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584122.019388:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc8368cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584122.019584:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253848960 00000100:00100000:3.0:1789584122.019595:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253848960 00000100:00100000:3.0:1789584122.019687:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789584122.019699:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:21942:x1876514253848960:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789584122.019727:0:21938:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789584122.019750:0:21938:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789584122.019754:0:21938:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1789584122.019878:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:21942:x1876514253848960:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 181us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584122.019888:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789584122.021605:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253848960:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789584122.021737:0:21942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789584122.021753:0:21942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8ded95c000/0x113b6add9f86963a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869641 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584122.021769:0:21942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8ded95c000/0x113b6add9f86963a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869641 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584122.021783:0:21942:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789584122.021786:0:21942:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8dff997800 from 14 10000000:01000000:1.0:1789584122.021790:0:21942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789584122.022268:0:21942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8ded95c800/0x113b6add9f869648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584122.022280:0:21942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8ded95c800/0x113b6add9f869648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584122.022292:0:21942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8ded95c800/0x113b6add9f869648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584122.022317:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253849088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789584122.022413:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584122.022474:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df74c9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789584122.025398:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253849088 00000100:00100000:2.0:1789584122.025420:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253849088 00000100:00100000:2.0:1789584122.025502:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789584122.025514:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:21942:x1876514253849088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789584122.025537:0:21939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584122.025565:0:21939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8e02047e00/0x113b6add9f86964f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f869648 expref: -99 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584122.025611:0:21939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8e02047e00/0x113b6add9f86964f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f869648 expref: 24 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584122.025627:0:21939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8e02047e00/0x113b6add9f86964f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869648 expref: 24 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584122.025637:0:21939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8e02047e00, rc 0) 00000100:00100000:2.0:1789584122.025743:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:21942:x1876514253849088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 231us (3331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584122.025751:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789584122.030051:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253849088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789584122.030095:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8ded95c800/0x113b6add9f869648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86964f expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584122.030113:0:21942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8ded95c800/0x113b6add9f869648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f86964f expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584122.030237:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253849216:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789584122.030347:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584122.030406:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc6fcb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584122.030643:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253849216 00000100:00100000:3.0:1789584122.030654:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253849216 00000100:00100000:3.0:1789584122.030725:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789584122.030736:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:21942:x1876514253849216:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789584122.030765:0:21937:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789584122.030789:0:21937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789584122.030793:0:21937:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1789584122.030933:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:21942:x1876514253849216:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 197us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584122.030942:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789584122.031281:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253849216:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789584122.031367:0:21942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789584122.031379:0:21942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8ded95c800/0x113b6add9f869648 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86964f expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584122.031390:0:21942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8ded95c800/0x113b6add9f869648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86964f expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584122.525375:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584123.553884:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584124.571303:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584124.892143:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253849344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789584124.892232:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584124.892269:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789584124.892275:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253849472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789584124.892312:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584124.893057:0:23259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253849344 00000100:00100000:2.0:1789584124.893067:0:23259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253849344 00000100:00100000:2.0:1789584124.893112:0:23259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253849472 00000100:00100000:2.0:1789584124.893114:0:23259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253849472 00000100:00100000:2.0:1789584124.893143:0:23259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789584124.893152:0:23259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3454:x1876514253849344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789584124.893207:0:23259:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789584124.893273:0:23259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3454:x1876514253849344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584124.893281:0:23259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789584124.893312:0:23259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789584124.893318:0:23259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253849472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789584124.893328:0:23259:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789584124.893353:0:23259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253849472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584124.893359:0:23259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789584124.893377:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789584124.893415:0:3454:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1789584124.893437:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253849472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789584124.893451:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253849344:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789584125.033056:0:8131:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1789584125.033121:0:8131:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789584125.403583:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789584125.403608:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253849600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789584125.403685:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584125.403855:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253849600 00000100:00100000:1.0:1789584125.403864:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253849600 00000100:00100000:1.0:1789584125.403923:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789584125.403933:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253849600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789584125.403974:0:21951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789584125.404025:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253849600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584125.404033:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789584125.404130:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253849600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789584125.404343:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253849728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789584125.404378:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584125.405009:0:22867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253849728 00000100:00100000:1.0:1789584125.405015:0:22867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253849728 00000100:00100000:1.0:1789584125.405057:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789584125.405065:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253849728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789584125.405096:0:22867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789584125.406161:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253849728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1092us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584125.406172:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789584125.410261:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253849728:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789584125.596084:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789584125.915531:0:20556:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789584125.915539:0:20556:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789584125.915544:0:20556:0:(import.c:65:import_set_state_nolock()) ffff8f8cc3f57000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789584125.915552:0:20556:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 773 00000100:00080000:0.0:1789584125.915557:0:20556:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789584125.915569:0:20556:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f8cc3f57000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1789584125.915603:0:20556:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8df4f28e00 x1876514253850240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789584125.915651:0:20556:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789584125.915654:0:20556:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789584125.915656:0:20556:0:(import.c:65:import_set_state_nolock()) ffff8f8dc93a0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789584125.915659:0:20556:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 773 00000100:00080000:0.0:1789584125.915661:0:20556:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789584125.915667:0:20556:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f8dc93a0800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1789584125.915679:0:20556:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8df4f28000 x1876514253850752/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789584125.915739:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253849984:0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.915801:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584125.915843:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253850624:0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.915866:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584125.915881:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc44ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3455:1876514253851264:0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.915910:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584125.915932:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789584125.915937:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3455:1876514253849856:0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.915965:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584125.915987:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253850496:0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.916009:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584125.916024:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc44a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3455:1876514253851136:0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.916045:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584125.916069:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253850112:0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.916101:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584125.916115:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3456:1876514253850880:0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.916132:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584125.916143:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc44a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3456:1876514253851392:0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.916162:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584125.916174:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789584125.916178:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876514253850368:0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.916236:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584125.916248:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3456:1876514253851008:0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.916270:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584125.916295:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253849984 00000100:00100000:0.0:1789584125.916302:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253849984 00000100:00100000:0.0:1789584125.916341:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253850496 00000100:00100000:0.0:1789584125.916343:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253850496 00000100:00100000:0.0:1789584125.916359:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789584125.916368:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253849984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.916435:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253849984:12345-0@lo:400:kworker.0 Request processed in 68us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584125.916442:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789584125.916458:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789584125.916463:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253850496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.916491:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253850496:12345-0@lo:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584125.916497:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789584125.916516:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253849856 00000100:00100000:0.0:1789584125.916520:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253849856 00000100:00100000:0.0:1789584125.916553:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789584125.916559:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:3455:x1876514253849856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.916590:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:3455:x1876514253849856:12345-0@lo:400:kworker.0 Request processed in 31us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584125.916596:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789584125.916643:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3455:1876514253849856:0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.916655:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253850496:0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.916664:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253849984:0@lo:400:kworker.0 00000100:00100000:2.0:1789584125.916970:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253850240:0@lo:8:kworker.0 00000100:00100000:2.0:1789584125.917003:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584125.917021:0:3453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253850752:0@lo:8:kworker.0 00000100:00100000:2.0:1789584125.917044:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584125.917073:0:23255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253850624 00000100:00100000:2.0:1789584125.917077:0:23255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253850624 00000100:00100000:2.0:1789584125.917098:0:23255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253850112 00000100:00100000:2.0:1789584125.917101:0:23255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253850112 00000100:00100000:2.0:1789584125.917111:0:23255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253850240 00000100:00100000:2.0:1789584125.917113:0:23255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253850240 00000100:00100000:2.0:1789584125.917121:0:23255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253850752 00000100:00100000:2.0:1789584125.917123:0:23255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253850752 00000100:00100000:2.0:1789584125.917137:0:23255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789584125.917144:0:23255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253850624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584125.917208:0:23255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253850624:12345-0@lo:400:kworker.0 Request processed in 64us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584125.917214:0:23255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789584125.917232:0:23255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789584125.917237:0:23255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253850112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584125.917265:0:23255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253850112:12345-0@lo:400:kworker.0 Request processed in 28us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584125.917270:0:23255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789584125.917282:0:23255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789584125.917286:0:23255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3453:x1876514253850240:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789584125.917312:0:23255:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 779 last 0 00000020:00000080:2.0:1789584125.917341:0:23255:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x113b6add9f869656 00002000:00100000:2.0:1789584125.917354:0:23255:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f8ded940000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789584125.917358:0:23255:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789584125.917361:0:23255:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789584125.917707:0:23255:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1789584125.917848:0:23759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789584125.917854:0:23759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3453:x1876514253850752:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789584125.917871:0:23759:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 779 last 0 00000020:00000080:1.0:1789584125.917903:0:23759:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x113b6add9f86965d 00002000:00100000:1.0:1789584125.917910:0:23759:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8f8cc6cae800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789584125.917914:0:23759:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1789584125.917916:0:23759:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789584125.917957:0:23759:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789584125.917987:0:23759:0:(import.c:65:import_set_state_nolock()) ffff8f8cc6cab800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789584125.918038:0:23759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3453:x1876514253850752:12345-0@lo:8:kworker.0 Request processed in 183us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584125.918045:0:23759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789584125.918066:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253851264 00000100:00100000:1.0:1789584125.918070:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253851264 00000100:00100000:1.0:1789584125.918101:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253851136 00000100:00100000:1.0:1789584125.918105:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253851136 00000100:00100000:1.0:1789584125.918116:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253850880 00000100:00100000:1.0:1789584125.918119:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253850880 00000100:00100000:1.0:1789584125.918128:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253851392 00000100:00100000:1.0:1789584125.918131:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253851392 00000100:00100000:1.0:1789584125.918141:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253850368 00000100:00100000:1.0:1789584125.918144:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253850368 00000100:00100000:1.0:1789584125.918154:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253851008 00000100:00100000:1.0:1789584125.918156:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253851008 00000100:00100000:1.0:1789584125.918169:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789584125.918174:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876514253851264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584125.918227:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876514253851264:12345-0@lo:400:kworker.0 Request processed in 52us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584125.918234:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789584125.918248:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789584125.918254:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876514253851136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584125.918282:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876514253851136:12345-0@lo:400:kworker.0 Request processed in 28us (2235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584125.918287:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789584125.918299:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789584125.918304:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3456:x1876514253850880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584125.918332:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3456:x1876514253850880:12345-0@lo:400:kworker.0 Request processed in 27us (2198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584125.918344:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789584125.918356:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789584125.918362:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3456:x1876514253851392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584125.918404:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3456:x1876514253851392:12345-0@lo:400:kworker.0 Request processed in 42us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584125.918410:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789584125.918421:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789584125.918427:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876514253850368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584125.918451:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876514253850368:12345-0@lo:400:kworker.0 Request processed in 25us (2214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584125.918456:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789584125.918467:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789584125.918472:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876514253851008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584125.918494:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876514253851008:12345-0@lo:400:kworker.0 Request processed in 22us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584125.918500:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789584125.918538:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789584125.918543:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789584125.918804:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8df4f28000 x1876514253850752/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789584150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584125.918814:0:3453:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789584125.918823:0:3453:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789584125.918833:0:3453:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789584125.918838:0:3453:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789584125.918841:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8dc93a0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789584125.918860:0:3453:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789584125.918865:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3453:1876514253850752:0@lo:8:kworker.0 00000004:00080000:1.0:1789584125.918965:0:22592:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789584125.918985:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22592:1876514253851648:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789584125.919017:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584125.919037:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8de0924780 going to sleep for 11 seconds 00000100:00100000:1.0:1789584125.919060:0:23759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253851648 00000100:00100000:1.0:1789584125.919066:0:23759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253851648 00000100:00100000:1.0:1789584125.919095:0:23759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789584125.919102:0:23759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:22592:x1876514253851648:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1789584125.922728:0:23255:0:(import.c:65:import_set_state_nolock()) ffff8f8ded946800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789584125.922846:0:23255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3453:x1876514253850240:12345-0@lo:8:kworker.0 Request processed in 5553us (5837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584125.922858:0:23255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789584125.922952:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8df4f28e00 x1876514253850240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789584150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584125.922966:0:3453:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789584125.922976:0:3453:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789584125.922986:0:3453:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789584125.923000:0:3453:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789584125.923002:0:3453:0:(import.c:65:import_set_state_nolock()) ffff8f8cc3f57000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789584125.923016:0:3453:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789584125.923022:0:3453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3453:1876514253850240:0@lo:8:kworker.0 00000004:00080000:2.0:1789584125.923085:0:21972:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1789584125.923107:0:21972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc75500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21972:1876514253851904:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789584125.923145:0:21972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584125.923168:0:21972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dfcdf2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789584125.923202:0:23257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253851904 00000100:00100000:2.0:1789584125.923209:0:23257:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253851904 00000100:00100000:2.0:1789584125.923250:0:23257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789584125.923259:0:23257:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:21972:x1876514253851904:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789584125.923316:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253851776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789584125.923343:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584125.923384:0:23259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253851776 00000100:00100000:2.0:1789584125.923389:0:23259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253851776 00000100:00100000:2.0:1789584125.923414:0:23259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789584125.923420:0:23259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3454:x1876514253851776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789584125.923443:0:23259:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789584125.923480:0:23259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3454:x1876514253851776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584125.923486:0:23259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789584125.923514:0:3454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8defc76a00 x1876514253851776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789584141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584125.923529:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253851776:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789584125.923572:0:3455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8cc44a9500 x1876514253851136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584125.923581:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc44a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3455:1876514253851136:0@lo:400:kworker.0 00000100:00100000:2.0:1789584125.923593:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253850624:0@lo:400:kworker.0 00010000:00080000:2.0:1789584125.923608:0:3455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8cc44ab100 x1876514253851264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584125.923616:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc44ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3455:1876514253851264:0@lo:400:kworker.0 00000100:00080000:2.0:1789584125.923660:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789584125.924802:0:22591:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789584125.925301:0:22591:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 779241111734ns, next at 0ns, rc = 0 00000004:00080000:0.0:1789584125.925351:0:21971:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789584125.925660:0:21971:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779241471137ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789584125.926020:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253851520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789584125.926079:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789584125.926144:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8df4f28380 x1876514253850368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584125.926159:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876514253850368:0@lo:400:kworker.0 00010000:00080000:0.0:1789584125.926173:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8df4f2b800 x1876514253851008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584125.926182:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3456:1876514253851008:0@lo:400:kworker.0 00000100:00100000:0.0:1789584125.926214:0:3456:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1789584125.926229:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253850112:0@lo:400:kworker.0 00010000:00080000:0.0:1789584125.926240:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8df4f2ad80 x1876514253850880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584125.926258:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3456:1876514253850880:0@lo:400:kworker.0 00000100:00100000:2.0:1789584125.926552:0:23259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253851520 00000100:00100000:2.0:1789584125.926559:0:23259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253851520 00000100:00100000:2.0:1789584125.926600:0:23259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789584125.926609:0:23259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3457:x1876514253851520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789584125.926645:0:23259:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789584125.926691:0:23259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3457:x1876514253851520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584125.926699:0:23259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789584125.926930:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8df4fa1f80 x1876514253851520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789584141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584125.926947:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253851520:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789584125.929815:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8cc44a9180 x1876514253851392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584125.930784:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc44a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3456:1876514253851392:0@lo:400:kworker.0 00002000:00080000:0.0:1789584125.939696:0:23759:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789584125.939709:0:23759:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789584125.943431:0:23759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:22592:x1876514253851648:12345-0@lo:7:osp-pre-1-1.0 Request processed in 24299us (24383us total) trans 0 rc 0/0 00010000:00080000:3.0:1789584125.944862:0:22592:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8df4fa0a80 x1876514253851648/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789584141 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584125.944883:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22592:1876514253851648:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789584125.944903:0:22592:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789584125.944955:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22592:1876514253852032:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789584125.945008:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584125.945036:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8de06ab9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584125.945062:0:23255:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1789584125.945069:0:23255:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789584125.946139:0:23759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789584125.949827:0:23759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253852032 00000100:00100000:0.0:1789584125.949849:0:23759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253852032 00000100:00100000:0.0:1789584125.949907:0:23258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789584125.949919:0:23258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22592:x1876514253852032:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789584125.949948:0:23258:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1789584125.950025:0:23258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22592:x1876514253852032:12345-0@lo:5:osp-pre-1-1.0 Request processed in 109us (5017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584125.950033:0:23258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789584125.950076:0:22592:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dc4c5ca80 x1876514253852032/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789584141 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584125.950091:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22592:1876514253852032:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789584125.950105:0:22592:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789584125.950148:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc44a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22592:1876514253852160:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789584125.950184:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584125.950230:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df74c9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789584125.950243:0:23258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253852160 00000100:00100000:0.0:1789584125.950246:0:23258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253852160 00000100:00100000:0.0:1789584125.950263:0:23258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789584125.950269:0:23258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22592:x1876514253852160:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789584125.950299:0:23258:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00080000:1.0:1789584125.979466:0:23257:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789584125.979478:0:23257:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1789584125.979484:0:23257:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00000004:00080000:0.0:1789584126.025546:0:7262:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789584126.035001:0:23258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:22592:x1876514253852160:12345-0@lo:5:osp-pre-1-1.0 Request processed in 84722us (84806us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789584126.035020:0:23258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789584126.035770:0:22592:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8cc44a9180 x1876514253852160/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789584141 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584126.035789:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc44a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22592:1876514253852160:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789584126.035805:0:22592:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1789584126.035870:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc76a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:22592:1876514253852288:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789584126.035917:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584126.035946:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc2eec900 going to sleep for 11 seconds 00000100:00100000:2.0:1789584126.035967:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253852288 00000100:00100000:2.0:1789584126.035973:0:21957:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253852288 00000100:00100000:2.0:1789584126.036018:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789584126.036027:0:21957:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22592:x1876514253852288:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789584126.036076:0:21957:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22592:x1876514253852288:12345-0@lo:900:osp-pre-1-1.0 Request processed in 51us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584126.036083:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789584126.036118:0:22592:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8defc76a00 x1876514253852288/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789584142 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584126.036127:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc76a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:22592:1876514253852288:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1789584126.044002:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789584126.044016:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019cf7408/0x113b6add9f869664 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.044034:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=779s v=(0 0) 00010000:00010000:0.0:1789584126.044039:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584126.044044:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019cf7408/0x113b6add9f869664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.044061:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019cf7408/0x113b6add9f869664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.044072:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019cf7408/0x113b6add9f869664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.044079:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019cf7408/0x113b6add9f869664 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.044121:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789584126.045300:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789584126.045310:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019cf7408/0x113b6add9f869664 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.045322:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc0030a00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:1.0:1789584126.045327:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019cf7408/0x113b6add9f869664 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.045337:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019cf7408/0x113b6add9f869664 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.045356:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019cf7408/0x113b6add9f869664 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.045390:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019cf7408/0x113b6add9f869664 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.045414:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584126.045416:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584126.045417:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789584126.058634:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789584126.058649:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026304892/0x113b6add9f86966b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.058666:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=779s v=(0 0) 00010000:00010000:0.0:1789584126.058671:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584126.058677:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026304892/0x113b6add9f86966b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.058692:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026304892/0x113b6add9f86966b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.058703:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026304892/0x113b6add9f86966b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.058711:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026304892/0x113b6add9f86966b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.058732:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789584126.059308:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789584126.059314:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b48a7cb/0x113b6add9f869672 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.059324:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=779s v=(0 0) 00010000:00010000:0.0:1789584126.059334:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584126.059338:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b48a7cb/0x113b6add9f869672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.059347:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b48a7cb/0x113b6add9f869672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.059354:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b48a7cb/0x113b6add9f869672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.059361:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b48a7cb/0x113b6add9f869672 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.059391:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789584126.059406:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789584126.059412:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026304892/0x113b6add9f86966b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.059418:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc0030c00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584126.059423:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026304892/0x113b6add9f86966b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.060667:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789584126.060853:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.060861:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b48a7cb/0x113b6add9f869672 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.060872:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc0030400 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584126.060875:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b48a7cb/0x113b6add9f869672 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.060885:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b48a7cb/0x113b6add9f869672 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.060907:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b48a7cb/0x113b6add9f869672 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.060921:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b48a7cb/0x113b6add9f869672 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.060945:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.060947:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.060949:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.060954:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.060955:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.061960:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026304892/0x113b6add9f86966b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.061990:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026304892/0x113b6add9f86966b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.062013:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026304892/0x113b6add9f86966b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.062034:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.062037:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.062038:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789584126.065633:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789584126.065649:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b9c147/0x113b6add9f869679 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.065669:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=779s v=(0 0) 00010000:00010000:0.0:1789584126.065675:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584126.065681:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b9c147/0x113b6add9f869679 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.065697:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b9c147/0x113b6add9f869679 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.065709:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b9c147/0x113b6add9f869679 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.065718:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b9c147/0x113b6add9f869679 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.065800:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789584126.072956:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789584126.072977:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f869680 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.072997:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=779s v=(0 0) 00010000:00010000:0.0:1789584126.073003:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584126.073011:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f869680 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.073029:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f869680 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.073041:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f869680 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.073049:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f869680 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.076606:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789584126.076621:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b9c147/0x113b6add9f869679 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.076636:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5f200 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584126.076641:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b9c147/0x113b6add9f869679 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.076652:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b9c147/0x113b6add9f869679 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.076674:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b9c147/0x113b6add9f869679 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.076682:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b9c147/0x113b6add9f869679 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.076715:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789584126.076729:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f869680 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.076735:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5e000 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584126.076738:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f869680 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.076745:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f869680 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.076756:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f869680 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.076763:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.076765:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.076767:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.081335:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789584126.081357:0:23257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f869680 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.082089:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789584126.082412:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789584126.082421:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019ffb794/0x113b6add9f869687 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.082531:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=779s v=(0 0) 00010000:00010000:0.0:1789584126.082536:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584126.082550:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019ffb794/0x113b6add9f869687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.082564:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019ffb794/0x113b6add9f869687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.082574:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019ffb794/0x113b6add9f869687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.082582:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019ffb794/0x113b6add9f869687 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.082615:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789584126.082927:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789584126.082934:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019ffb794/0x113b6add9f869687 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.082943:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5ea00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:1.0:1789584126.082948:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019ffb794/0x113b6add9f869687 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.082958:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019ffb794/0x113b6add9f869687 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.082975:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019ffb794/0x113b6add9f869687 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.082982:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019ffb794/0x113b6add9f869687 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.082999:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584126.083000:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584126.083009:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789584126.083386:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789584126.083393:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000009b51bf/0x113b6add9f86968e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.083401:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=779s v=(0 0) 00010000:00010000:0.0:1789584126.083405:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584126.083409:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000009b51bf/0x113b6add9f86968e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.083419:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000009b51bf/0x113b6add9f86968e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.083426:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000009b51bf/0x113b6add9f86968e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.083521:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000009b51bf/0x113b6add9f86968e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.083536:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789584126.087692:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789584126.087710:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084d18d7b/0x113b6add9f869695 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.087731:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=779s v=(0 0) 00010000:00010000:0.0:1789584126.087735:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584126.087741:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084d18d7b/0x113b6add9f869695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.087757:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084d18d7b/0x113b6add9f869695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.087767:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084d18d7b/0x113b6add9f869695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.087776:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084d18d7b/0x113b6add9f869695 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.087803:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789584126.089993:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789584126.090005:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000009b51bf/0x113b6add9f86968e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.090018:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5e400 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584126.090023:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000009b51bf/0x113b6add9f86968e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.090033:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000009b51bf/0x113b6add9f86968e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.090054:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000009b51bf/0x113b6add9f86968e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.090069:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000009b51bf/0x113b6add9f86968e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.090090:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789584126.090093:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084d18d7b/0x113b6add9f869695 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.090100:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5e600 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584126.090103:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084d18d7b/0x113b6add9f869695 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.090111:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084d18d7b/0x113b6add9f869695 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.090121:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084d18d7b/0x113b6add9f869695 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.090127:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084d18d7b/0x113b6add9f869695 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.090138:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.090140:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.090142:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.092256:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789584126.093064:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789584126.093083:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5785afe/0x113b6add9f86969c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.093101:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=779s v=(0 0) 00010000:00010000:0.0:1789584126.093105:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584126.093111:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5785afe/0x113b6add9f86969c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.093124:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5785afe/0x113b6add9f86969c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.093134:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5785afe/0x113b6add9f86969c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.093141:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5785afe/0x113b6add9f86969c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.093169:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789584126.093563:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789584126.093729:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789584126.093737:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5785afe/0x113b6add9f86969c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.093753:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5f800 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584126.093758:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5785afe/0x113b6add9f86969c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.093767:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5785afe/0x113b6add9f86969c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.093785:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5785afe/0x113b6add9f86969c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.093793:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5785afe/0x113b6add9f86969c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.093810:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.093811:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.093813:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789584126.099005:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584126.099020:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b1cc853/0x113b6add9f8696a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.099037:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=779s v=(0 0) 00010000:00010000:1.0:1789584126.099042:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584126.099050:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b1cc853/0x113b6add9f8696a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.099067:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b1cc853/0x113b6add9f8696a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.099079:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b1cc853/0x113b6add9f8696a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.099087:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b1cc853/0x113b6add9f8696a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.099153:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789584126.099967:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584126.099976:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d056336e/0x113b6add9f8696aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.099987:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=779s v=(0 0) 00010000:00010000:1.0:1789584126.099990:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584126.099995:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d056336e/0x113b6add9f8696aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.100014:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d056336e/0x113b6add9f8696aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.100024:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d056336e/0x113b6add9f8696aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.100032:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d056336e/0x113b6add9f8696aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.102293:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789584126.102306:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b1cc853/0x113b6add9f8696a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.102320:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95da00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584126.102326:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b1cc853/0x113b6add9f8696a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.102337:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b1cc853/0x113b6add9f8696a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.102381:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b1cc853/0x113b6add9f8696a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.102389:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b1cc853/0x113b6add9f8696a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.102411:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789584126.102416:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d056336e/0x113b6add9f8696aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.102421:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95d600 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584126.102424:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d056336e/0x113b6add9f8696aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.102890:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d056336e/0x113b6add9f8696aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.102906:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d056336e/0x113b6add9f8696aa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.102915:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.102917:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.102919:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584126.103338:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789584126.103347:0:23257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d056336e/0x113b6add9f8696aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789584126.105278:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584126.105289:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c21b177/0x113b6add9f8696b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.105306:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=779s v=(0 0) 00010000:00010000:1.0:1789584126.105310:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584126.105317:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c21b177/0x113b6add9f8696b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.105331:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c21b177/0x113b6add9f8696b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.105353:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c21b177/0x113b6add9f8696b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.105361:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c21b177/0x113b6add9f8696b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.106530:0:24198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584126.106540:0:24198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c21b177/0x113b6add9f8696b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.106552:0:24198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95ca00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584126.106558:0:24198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c21b177/0x113b6add9f8696b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.106568:0:24198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c21b177/0x113b6add9f8696b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.106598:0:24198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c21b177/0x113b6add9f8696b1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.106608:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.106610:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.106613:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584126.106683:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789584126.106690:0:23257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c21b177/0x113b6add9f8696b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.106723:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789584126.108956:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584126.108969:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000489eb4d9/0x113b6add9f8696b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.108986:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=779s v=(0 0) 00010000:00010000:1.0:1789584126.108990:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584126.108997:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000489eb4d9/0x113b6add9f8696b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.109011:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000489eb4d9/0x113b6add9f8696b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.109022:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000489eb4d9/0x113b6add9f8696b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.109042:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000489eb4d9/0x113b6add9f8696b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.109105:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789584126.109619:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584126.109626:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f014d0e/0x113b6add9f8696bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.109636:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=779s v=(0 0) 00010000:00010000:1.0:1789584126.109639:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584126.109643:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f014d0e/0x113b6add9f8696bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.109653:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f014d0e/0x113b6add9f8696bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.109660:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f014d0e/0x113b6add9f8696bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.109667:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f014d0e/0x113b6add9f8696bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.112044:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789584126.112061:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000489eb4d9/0x113b6add9f8696b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.112092:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95cc00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584126.112097:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000489eb4d9/0x113b6add9f8696b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.112110:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000489eb4d9/0x113b6add9f8696b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.112132:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000489eb4d9/0x113b6add9f8696b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.112139:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000489eb4d9/0x113b6add9f8696b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.112165:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789584126.112168:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f014d0e/0x113b6add9f8696bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.112174:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95d800 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584126.112177:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f014d0e/0x113b6add9f8696bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.112184:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f014d0e/0x113b6add9f8696bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.112209:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f014d0e/0x113b6add9f8696bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.112222:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.112224:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.112226:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584126.115632:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789584126.115650:0:23257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f014d0e/0x113b6add9f8696bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789584126.116416:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584126.116427:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c904aa0/0x113b6add9f8696c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.116455:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=779s v=(0 0) 00010000:00010000:1.0:1789584126.116460:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584126.116469:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c904aa0/0x113b6add9f8696c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.116483:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c904aa0/0x113b6add9f8696c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.116492:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c904aa0/0x113b6add9f8696c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.116501:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c904aa0/0x113b6add9f8696c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.122557:0:24198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584126.122573:0:24198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c904aa0/0x113b6add9f8696c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.122589:0:24198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95c600 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584126.122594:0:24198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c904aa0/0x113b6add9f8696c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.122605:0:24198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c904aa0/0x113b6add9f8696c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.122628:0:24198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c904aa0/0x113b6add9f8696c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.122657:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.122659:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.122661:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584126.122935:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789584126.122944:0:23257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c904aa0/0x113b6add9f8696c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789584126.123704:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584126.123713:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006acb16f8/0x113b6add9f8696cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.123738:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=779s v=(0 0) 00010000:00010000:1.0:1789584126.123742:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584126.123749:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006acb16f8/0x113b6add9f8696cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.123763:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006acb16f8/0x113b6add9f8696cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.123774:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006acb16f8/0x113b6add9f8696cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.123782:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006acb16f8/0x113b6add9f8696cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.130939:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789584126.130956:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006acb16f8/0x113b6add9f8696cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.130970:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95d200 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584126.130976:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006acb16f8/0x113b6add9f8696cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.130989:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006acb16f8/0x113b6add9f8696cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.131015:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006acb16f8/0x113b6add9f8696cd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.131029:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.131031:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.131033:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584126.131178:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789584126.131200:0:23257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006acb16f8/0x113b6add9f8696cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789584126.132099:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584126.132108:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc8598f6/0x113b6add9f8696d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.132123:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=779s v=(0 0) 00010000:00010000:1.0:1789584126.132128:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584126.132135:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc8598f6/0x113b6add9f8696d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.132161:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc8598f6/0x113b6add9f8696d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.132172:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc8598f6/0x113b6add9f8696d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.132180:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc8598f6/0x113b6add9f8696d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.132227:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789584126.132556:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789584126.132564:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc8598f6/0x113b6add9f8696d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.132572:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95de00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584126.132576:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc8598f6/0x113b6add9f8696d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.132592:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc8598f6/0x113b6add9f8696d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.132609:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc8598f6/0x113b6add9f8696d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.132617:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc8598f6/0x113b6add9f8696d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.132636:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.132638:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.132640:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.133250:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789584126.134963:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789584126.134976:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000985e732f/0x113b6add9f8696db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.134996:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=779s v=(0 0) 00010000:00010000:1.0:1789584126.135001:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584126.135008:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000985e732f/0x113b6add9f8696db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.135022:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000985e732f/0x113b6add9f8696db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.135033:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000985e732f/0x113b6add9f8696db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.135053:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000985e732f/0x113b6add9f8696db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.135257:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789584126.137311:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789584126.137322:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f8696e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.137351:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=779s v=(0 0) 00010000:00010000:0.0:1789584126.137356:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584126.137363:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f8696e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.137390:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f8696e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.137401:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f8696e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.137410:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f8696e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.138562:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789584126.138575:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000985e732f/0x113b6add9f8696db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.138588:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95c400 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584126.138594:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000985e732f/0x113b6add9f8696db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.138607:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000985e732f/0x113b6add9f8696db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.138630:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000985e732f/0x113b6add9f8696db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.138651:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000985e732f/0x113b6add9f8696db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.141020:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789584126.141052:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584126.141060:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f8696e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.141075:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5e000 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584126.141081:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f8696e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.141093:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f8696e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.141131:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f8696e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.141138:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb150c2d/0x113b6add9f8696e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.141160:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.141162:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.141165:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584126.141320:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789584126.142240:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789584126.142252:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055b546ee/0x113b6add9f8696e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.142264:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=779s v=(0 0) 00010000:00010000:0.0:1789584126.142268:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584126.142275:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055b546ee/0x113b6add9f8696e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.142288:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055b546ee/0x113b6add9f8696e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.142298:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055b546ee/0x113b6add9f8696e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.142306:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055b546ee/0x113b6add9f8696e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.142338:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789584126.143547:0:24198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789584126.143558:0:24198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055b546ee/0x113b6add9f8696e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.143570:0:24198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5ee00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584126.143575:0:24198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055b546ee/0x113b6add9f8696e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.143585:0:24198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055b546ee/0x113b6add9f8696e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.143607:0:24198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055b546ee/0x113b6add9f8696e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.143614:0:24198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055b546ee/0x113b6add9f8696e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584126.143634:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.143636:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789584126.143638:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789584126.145070:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789584126.145080:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f8696f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.145098:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=779s v=(0 0) 00010000:00010000:0.0:1789584126.145102:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584126.145109:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f8696f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.145123:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f8696f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.145133:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f8696f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.145141:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f8696f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.145162:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789584126.145179:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584126.145183:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f8696f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.145217:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5ec00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584126.145228:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f8696f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.145236:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f8696f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.145251:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f8696f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.145259:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f8696f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.145275:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.145277:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.145278:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789584126.148396:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789584126.148407:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000752194f4/0x113b6add9f8696f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.148424:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=779s v=(0 0) 00010000:00010000:0.0:1789584126.148429:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584126.149756:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000752194f4/0x113b6add9f8696f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.149776:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000752194f4/0x113b6add9f8696f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.149787:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000752194f4/0x113b6add9f8696f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.149804:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000752194f4/0x113b6add9f8696f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.149895:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789584126.149924:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584126.149931:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000752194f4/0x113b6add9f8696f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.149940:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5e800 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584126.149945:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000752194f4/0x113b6add9f8696f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.149955:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000752194f4/0x113b6add9f8696f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.149986:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000752194f4/0x113b6add9f8696f7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.149995:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584126.149997:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584126.149999:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.150522:0:23257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000752194f4/0x113b6add9f8696f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789584126.151687:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789584126.151698:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024fc152a/0x113b6add9f8696fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.151711:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=779s v=(0 0) 00010000:00010000:3.0:1789584126.151715:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584126.151721:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024fc152a/0x113b6add9f8696fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.151733:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024fc152a/0x113b6add9f8696fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.151742:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024fc152a/0x113b6add9f8696fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.151750:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024fc152a/0x113b6add9f8696fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.151813:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789584126.152350:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789584126.152363:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869705 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.152388:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=779s v=(0 0) 00010000:00010000:3.0:1789584126.152392:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584126.152396:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.152407:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.152416:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.152424:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869705 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.152682:0:24198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789584126.152690:0:24198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024fc152a/0x113b6add9f8696fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.152698:0:24198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8400 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584126.152702:0:24198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024fc152a/0x113b6add9f8696fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.152711:0:24198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024fc152a/0x113b6add9f8696fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.152727:0:24198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024fc152a/0x113b6add9f8696fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.152735:0:24198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024fc152a/0x113b6add9f8696fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.152750:0:24198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584126.152759:0:24198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869705 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.152766:0:24198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8200 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584126.152769:0:24198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869705 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.152777:0:24198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869705 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.152788:0:24198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869705 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.152796:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.152797:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.152799:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584126.153998:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789584126.154009:0:23257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869705 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789584126.155357:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789584126.155381:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f86970c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.155396:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=779s v=(0 0) 00010000:00010000:3.0:1789584126.155400:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584126.155412:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f86970c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.155427:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f86970c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.155450:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f86970c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.155457:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f86970c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.156985:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789584126.156997:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f86970c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.157015:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe9a00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:1.0:1789584126.157020:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f86970c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.157030:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f86970c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.157049:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f86970c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584126.157059:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584126.157061:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584126.157063:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584126.157204:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789584126.157211:0:23257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f86970c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.157246:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789584126.157877:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789584126.157885:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8a43a71/0x113b6add9f869713 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.157898:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=779s v=(0 0) 00010000:00010000:3.0:1789584126.157902:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584126.157909:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8a43a71/0x113b6add9f869713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.157923:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8a43a71/0x113b6add9f869713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.157941:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8a43a71/0x113b6add9f869713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.157949:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8a43a71/0x113b6add9f869713 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.157974:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789584126.158419:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789584126.158425:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f86971a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.158434:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=779s v=(0 0) 00010000:00010000:3.0:1789584126.158437:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584126.158441:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f86971a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.158452:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f86971a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.158459:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f86971a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.158466:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f86971a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.158507:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789584126.158522:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789584126.158527:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8a43a71/0x113b6add9f869713 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.158535:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8e00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584126.158538:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8a43a71/0x113b6add9f869713 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.158546:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8a43a71/0x113b6add9f869713 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.158559:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8a43a71/0x113b6add9f869713 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.158567:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8a43a71/0x113b6add9f869713 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.158583:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584126.158586:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f86971a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.158592:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8a00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584126.158595:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f86971a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.158614:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f86971a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.158625:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f86971a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.158632:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f86971a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.158643:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584126.158645:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584126.158646:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789584126.159059:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789584126.159065:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034561c4e/0x113b6add9f869721 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159073:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=779s v=(0 0) 00010000:00010000:3.0:1789584126.159076:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584126.159080:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034561c4e/0x113b6add9f869721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159089:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034561c4e/0x113b6add9f869721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159096:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034561c4e/0x113b6add9f869721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159108:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034561c4e/0x113b6add9f869721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159124:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789584126.159134:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584126.159138:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034561c4e/0x113b6add9f869721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159145:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe9200 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584126.159148:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034561c4e/0x113b6add9f869721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159156:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034561c4e/0x113b6add9f869721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159167:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034561c4e/0x113b6add9f869721 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159174:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034561c4e/0x113b6add9f869721 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159218:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584126.159220:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584126.159221:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789584126.159628:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789584126.159642:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0aa0cc3/0x113b6add9f869728 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159650:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=779s v=(0 0) 00010000:00010000:3.0:1789584126.159654:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584126.159658:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0aa0cc3/0x113b6add9f869728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159668:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0aa0cc3/0x113b6add9f869728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159676:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0aa0cc3/0x113b6add9f869728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159682:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0aa0cc3/0x113b6add9f869728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159697:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789584126.159705:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584126.159708:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0aa0cc3/0x113b6add9f869728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159715:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe9800 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584126.159718:0:21934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0aa0cc3/0x113b6add9f869728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159726:0:21934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0aa0cc3/0x113b6add9f869728 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159744:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0aa0cc3/0x113b6add9f869728 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159751:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0aa0cc3/0x113b6add9f869728 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.159764:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584126.159766:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584126.159768:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584126.160253:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789584126.162600:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789584126.162614:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070ae3ccb/0x113b6add9f86972f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.162631:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=779s v=(0 0) 00010000:00010000:3.0:1789584126.162635:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584126.162642:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070ae3ccb/0x113b6add9f86972f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.162657:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070ae3ccb/0x113b6add9f86972f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.162667:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070ae3ccb/0x113b6add9f86972f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.162675:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070ae3ccb/0x113b6add9f86972f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.162725:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789584126.163274:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584126.163284:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070ae3ccb/0x113b6add9f86972f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.163293:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe9400 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584126.163297:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070ae3ccb/0x113b6add9f86972f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.163307:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070ae3ccb/0x113b6add9f86972f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.163324:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070ae3ccb/0x113b6add9f86972f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.163337:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070ae3ccb/0x113b6add9f86972f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.163358:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.163360:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584126.163362:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789584126.165525:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789584126.165537:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000717f799b/0x113b6add9f869736 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.165553:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=779s v=(0 0) 00010000:00010000:3.0:1789584126.165557:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584126.165563:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000717f799b/0x113b6add9f869736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.165575:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000717f799b/0x113b6add9f869736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.165585:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000717f799b/0x113b6add9f869736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.165591:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000717f799b/0x113b6add9f869736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.165613:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789584126.166226:0:23257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789584126.166235:0:23257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cb14e6a/0x113b6add9f86973d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.166246:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=779s v=(0 0) 00010000:00010000:3.0:1789584126.166255:0:23257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584126.166260:0:23257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cb14e6a/0x113b6add9f86973d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.166271:0:23257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cb14e6a/0x113b6add9f86973d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.166280:0:23257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cb14e6a/0x113b6add9f86973d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.166287:0:23257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cb14e6a/0x113b6add9f86973d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.166307:0:23257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789584126.166322:0:24198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789584126.166328:0:24198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000717f799b/0x113b6add9f869736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.166335:0:24198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8800 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584126.166339:0:24198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000717f799b/0x113b6add9f869736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.166347:0:24198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000717f799b/0x113b6add9f869736 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.166361:0:24198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000717f799b/0x113b6add9f869736 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.166394:0:24198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000717f799b/0x113b6add9f869736 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.166413:0:24198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789584126.166416:0:24198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cb14e6a/0x113b6add9f86973d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.166423:0:24198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8000 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584126.166426:0:24198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cb14e6a/0x113b6add9f86973d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584126.166543:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584126.166581:0:24198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cb14e6a/0x113b6add9f86973d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.166591:0:24198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cb14e6a/0x113b6add9f86973d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.166598:0:24198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cb14e6a/0x113b6add9f86973d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584126.166611:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584126.166612:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584126.166613:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789584126.167456:0:23257:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1789584126.167551:0:23257:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:21972:x1876514253851904:12345-0@lo:5:osp-pre-1-0.0 Request processed in 244289us (244402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584126.167568:0:23257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789584126.167719:0:21972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc75500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21972:1876514253851904:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789584126.167733:0:21972:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1789584126.167788:0:21972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc75500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21972:1876514253852416:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789584126.167836:0:21972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584126.167861:0:21972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc2eeccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584126.167958:0:23759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253852416 00000100:00100000:3.0:1789584126.167966:0:23759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253852416 00000100:00100000:3.0:1789584126.168012:0:23759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789584126.168021:0:23759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:21972:x1876514253852416:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789584126.168061:0:23759:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1789584126.174693:0:23759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:21972:x1876514253852416:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6666us (6860us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789584126.174705:0:23759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789584126.174813:0:21972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc75500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21972:1876514253852416:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789584126.174840:0:21972:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1789584126.620354:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789584127.012059:0:21981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789584127.643411:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789584128.577860:0:24338:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789584128.668004:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584129.692550:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789584130.011693:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc44ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253852544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789584130.011791:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584130.011928:0:23259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253852544 00000100:00100000:0.0:1789584130.011937:0:23259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253852544 00000100:00100000:0.0:1789584130.012006:0:23259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789584130.012017:0:23259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253852544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789584130.012052:0:23259:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789584130.012099:0:23259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253852544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584130.012106:0:23259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789584130.012167:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789584130.012243:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc44ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253852544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789584130.013501:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253852672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789584130.013548:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584130.013651:0:23259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253852672 00000100:00100000:1.0:1789584130.013658:0:23259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253852672 00000100:00100000:1.0:1789584130.013718:0:23259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789584130.013727:0:23259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253852672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789584130.013744:0:23259:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789584130.013784:0:23259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253852672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584130.013791:0:23259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789584130.014004:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789584130.014036:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253852672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789584130.523588:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789584130.523613:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253852800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789584130.523707:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584130.523779:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253852800 00000100:00100000:1.0:1789584130.523787:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253852800 00000100:00100000:1.0:1789584130.523837:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789584130.523848:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253852800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789584130.524169:0:21950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789584130.524247:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253852800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 401us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584130.524254:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789584130.524324:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253852800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789584130.524340:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253852928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789584130.524372:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584130.524400:0:22867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253852928 00000100:00100000:1.0:1789584130.524406:0:22867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253852928 00000100:00100000:1.0:1789584130.524506:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789584130.524523:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253852928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789584130.524547:0:22867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789584130.524589:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253852928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584130.524594:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789584130.524669:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253852928:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789584130.715411:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584131.035724:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253853312:0@lo:400:kworker.0 00000100:00100000:3.0:1789584131.035813:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584131.035847:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253853824:0@lo:400:kworker.0 00000100:00100000:3.0:1789584131.035868:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584131.035881:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3457:1876514253854336:0@lo:400:kworker.0 00000100:00100000:3.0:1789584131.035907:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584131.035930:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789584131.035936:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253853184:0@lo:400:kworker.0 00000100:00100000:3.0:1789584131.035960:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584131.035986:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253853696:0@lo:400:kworker.0 00000100:00100000:3.0:1789584131.036007:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584131.036049:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3457:1876514253854208:0@lo:400:kworker.0 00000100:00100000:3.0:1789584131.036071:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584131.036104:0:24195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253853312 00000100:00100000:3.0:1789584131.036114:0:24195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253853312 00000100:00100000:3.0:1789584131.036160:0:24195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253853824 00000100:00100000:3.0:1789584131.036163:0:24195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253853824 00000100:00100000:3.0:1789584131.036180:0:24195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789584131.036211:0:24195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253853312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584131.036263:0:24195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253853312:12345-0@lo:400:kworker.0 Request processed in 74us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584131.036271:0:24195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789584131.036302:0:24195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789584131.036309:0:24195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253853824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584131.036336:0:24195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253853824:12345-0@lo:400:kworker.0 Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584131.036342:0:24195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789584131.036360:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253853184 00000100:00100000:3.0:1789584131.036363:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253853184 00000100:00100000:3.0:1789584131.036384:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253853696 00000100:00100000:3.0:1789584131.036386:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253853696 00000100:00100000:3.0:1789584131.036397:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789584131.036402:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253853184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584131.036430:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253853184:12345-0@lo:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584131.036436:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789584131.036446:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789584131.036452:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253853696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584131.036490:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253853696:12345-0@lo:400:kworker.0 Request processed in 38us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584131.036496:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789584131.036536:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253853184:0@lo:400:kworker.0 00000100:00100000:3.0:1789584131.036546:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253853696:0@lo:400:kworker.0 00000100:00100000:3.0:1789584131.036554:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253853312:0@lo:400:kworker.0 00000100:00100000:3.0:1789584131.036562:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253853824:0@lo:400:kworker.0 00000100:00100000:0.0:1789584131.036644:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3455:1876514253853056:0@lo:400:kworker.0 00000100:00100000:0.0:1789584131.036676:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584131.036705:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876514253853568:0@lo:400:kworker.0 00000100:00100000:0.0:1789584131.036723:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584131.036735:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876514253854080:0@lo:400:kworker.0 00000100:00100000:0.0:1789584131.036749:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584131.036757:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3455:1876514253854592:0@lo:400:kworker.0 00000100:00100000:0.0:1789584131.036771:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584131.036791:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789584131.036796:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253853440:0@lo:400:kworker.0 00000100:00100000:0.0:1789584131.036813:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584131.036824:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253853952:0@lo:400:kworker.0 00000100:00100000:0.0:1789584131.036839:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584131.036851:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3455:1876514253854464:0@lo:400:kworker.0 00000100:00100000:0.0:1789584131.036867:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584131.036884:0:23258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253853440 00000100:00100000:0.0:1789584131.036887:0:23258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253853440 00000100:00100000:0.0:1789584131.036914:0:23258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253853952 00000100:00100000:0.0:1789584131.036917:0:23258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253853952 00000100:00100000:0.0:1789584131.036929:0:23258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789584131.036934:0:23258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3455:x1876514253853440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584131.036962:0:23258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3455:x1876514253853440:12345-0@lo:400:kworker.0 Request processed in 27us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584131.036968:0:23258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789584131.036978:0:23258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789584131.036983:0:23258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3455:x1876514253853952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584131.037001:0:23258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3455:x1876514253853952:12345-0@lo:400:kworker.0 Request processed in 19us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584131.037007:0:23258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789584131.037020:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789584131.037040:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253853440:0@lo:400:kworker.0 00000100:00100000:0.0:1789584131.037050:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253853952:0@lo:400:kworker.0 00000100:00100000:2.0:1789584131.037600:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253854848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789584131.037631:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584131.037652:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789584131.037658:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8defc74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253854720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789584131.037678:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584131.037704:0:23260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253854848 00000100:00100000:2.0:1789584131.037708:0:23260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253854848 00000100:00100000:2.0:1789584131.037726:0:23260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253854720 00000100:00100000:2.0:1789584131.037728:0:23260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253854720 00000100:00100000:2.0:1789584131.037738:0:23260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789584131.037745:0:23260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3457:x1876514253854848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789584131.037768:0:23260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789584131.037804:0:23260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3457:x1876514253854848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584131.037810:0:23260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789584131.037826:0:23260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789584131.037839:0:23260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3457:x1876514253854720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789584131.037849:0:23260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789584131.037874:0:23260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3457:x1876514253854720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584131.037879:0:23260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789584131.037908:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253854720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789584131.037921:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8defc76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253854848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789584131.038474:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253854336 00000100:00100000:1.0:1789584131.038480:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253854336 00000100:00100000:1.0:1789584131.038509:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253854208 00000100:00100000:1.0:1789584131.038512:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253854208 00000100:00100000:1.0:1789584131.038523:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253853568 00000100:00100000:1.0:1789584131.038525:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253853568 00000100:00100000:1.0:1789584131.038536:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253854080 00000100:00100000:1.0:1789584131.038539:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253854080 00000100:00100000:1.0:1789584131.038548:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253854592 00000100:00100000:1.0:1789584131.038550:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253854592 00000100:00100000:1.0:1789584131.038561:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253854464 00000100:00100000:1.0:1789584131.038563:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253854464 00000100:00100000:1.0:1789584131.038576:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789584131.038584:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3457:x1876514253854336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584131.038650:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3457:x1876514253854336:12345-0@lo:400:kworker.0 Request processed in 67us (2741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.038656:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789584131.038671:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789584131.038677:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3457:x1876514253854208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584131.038704:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3457:x1876514253854208:12345-0@lo:400:kworker.0 Request processed in 28us (2632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.038721:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789584131.038733:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789584131.038739:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876514253853568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584131.038780:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876514253853568:12345-0@lo:400:kworker.0 Request processed in 31us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.038787:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789584131.038798:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789584131.038804:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876514253854080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584131.038831:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876514253854080:12345-0@lo:400:kworker.0 Request processed in 27us (2080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.038837:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789584131.038847:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789584131.038853:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876514253854592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584131.038878:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876514253854592:12345-0@lo:400:kworker.0 Request processed in 26us (2106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.038883:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789584131.038894:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789584131.038899:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876514253854464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584131.038923:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876514253854464:12345-0@lo:400:kworker.0 Request processed in 24us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.038929:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789584131.040743:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253853056 00000100:00100000:3.0:1789584131.040757:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253853056 00000100:00100000:3.0:1789584131.040819:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789584131.040829:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:3455:x1876514253853056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789584131.040912:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:3455:x1876514253853056:12345-0@lo:400:kworker.0 Request processed in 84us (4234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584131.040919:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1789584131.042590:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dff9ba300 x1876514253854208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584131.042609:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3457:1876514253854208:0@lo:400:kworker.0 00010000:00080000:2.0:1789584131.042623:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dff9baa00 x1876514253854336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584131.042631:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3457:1876514253854336:0@lo:400:kworker.0 00000100:00080000:0.0:1789584131.043686:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789584131.043694:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789584131.043738:0:3455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dff9bb800 x1876514253854464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584131.043751:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3455:1876514253854464:0@lo:400:kworker.0 00000100:00100000:0.0:1789584131.043763:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3455:1876514253853056:0@lo:400:kworker.0 00010000:00080000:0.0:1789584131.043775:0:3455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dff9ba680 x1876514253853568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584131.043782:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876514253853568:0@lo:400:kworker.0 00010000:00080000:0.0:1789584131.043793:0:3455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dff9b9880 x1876514253854080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584131.043802:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876514253854080:0@lo:400:kworker.0 00010000:00080000:0.0:1789584131.043813:0:3455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dff9bad80 x1876514253854592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789584131.043820:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3455:1876514253854592:0@lo:400:kworker.0 00000100:00100000:1.0:1789584131.074092:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584131.075581:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228556800 00000100:00100000:1.0:1789584131.075595:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228556800 00000100:00100000:1.0:1789584131.078825:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 114 00000100:00100000:1.0:1789584131.078844:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2398:x1876514228556800:12345-192.168.204.11@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789584131.078875:0:21937:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 98df0fde-e9b8-4032-b372-dfd508e8b711@192.168.204.11@tcp t0 exp 0000000000000000 cur 784 last 0 00000020:00000080:1.0:1789584131.078913:0:21937:0:(genops.c:1384:class_connect()) connect: client 98df0fde-e9b8-4032-b372-dfd508e8b711, cookie 0x113b6add9f869744 00000100:00080000:1.0:1789584131.079057:0:21937:0:(import.c:65:import_set_state_nolock()) ffff8f8cc6caa000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789584131.079124:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+5:2398:x1876514228556800:12345-192.168.204.11@tcp:250:mount.lustre.0 Request processed in 280us (5042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.079132:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 114 00000100:00100000:0.0:1789584131.086767:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584131.086968:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228556928 00000100:00100000:0.0:1789584131.086979:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228556928 00000100:00100000:0.0:1789584131.087030:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 115 00000100:00100000:0.0:1789584131.087040:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+5:18381:x1876514228556928:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789584131.087058:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789584131.087077:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8defc5fa00/0x113b6add9f86974b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee1a4 expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584131.087106:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8defc5fa00/0x113b6add9f86974b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee1a4 expref: 6 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584131.087136:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8defc5fa00/0x113b6add9f86974b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee1a4 expref: 6 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584131.087146:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8defc5fa00, rc 0) 00000100:00100000:0.0:1789584131.087221:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+6:18381:x1876514228556928:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 182us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584131.087229:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 115 00000100:00100000:3.0:1789584131.094637:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584131.096240:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228557056 00000100:00100000:2.0:1789584131.096257:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228557056 00000100:00100000:2.0:1789584131.096326:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 116 00000100:00100000:2.0:1789584131.096337:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+6:18381:x1876514228557056:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789584131.096630:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+6:18381:x1876514228557056:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 281us (1997us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789584131.096640:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 116 00000100:00100000:3.0:1789584131.103064:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584131.104102:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228557184 00000100:00100000:1.0:1789584131.104115:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228557184 00000100:00100000:1.0:1789584131.104169:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 117 00000100:00100000:1.0:1789584131.104179:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+6:18381:x1876514228557184:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789584131.104216:0:21937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584131.104237:0:21937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8ded95ca00/0x113b6add9f869752 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee1ab expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584131.104264:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8ded95ca00/0x113b6add9f869752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee1ab expref: 7 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584131.104288:0:21937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8ded95ca00/0x113b6add9f869752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee1ab expref: 7 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584131.104298:0:21937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8ded95ca00, rc 0) 00000100:00100000:1.0:1789584131.104358:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+7:18381:x1876514228557184:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 180us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.104365:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 117 00000100:00100000:0.0:1789584131.116416:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584131.117229:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228557312 00000100:00100000:3.0:1789584131.117242:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228557312 00000100:00100000:3.0:1789584131.117314:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 118 00000100:00100000:3.0:1789584131.117325:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+7:18381:x1876514228557312:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789584131.117922:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+8:18381:x1876514228557312:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 596us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584131.117931:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 118 00000100:00100000:2.0:1789584131.127035:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584131.127124:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228557440 00000100:00100000:1.0:1789584131.127135:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228557440 00000100:00100000:1.0:1789584131.127222:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 119 00000100:00100000:1.0:1789584131.127233:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+8:18381:x1876514228557440:12345-192.168.204.11@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789584131.127603:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+8:18381:x1876514228557440:12345-192.168.204.11@tcp:503:mount.lustre.0 Request processed in 371us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.127611:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 119 00000100:00100000:0.0:1789584131.143080:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584131.143158:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228557568 00000100:00100000:2.0:1789584131.143170:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228557568 00000100:00100000:2.0:1789584131.143237:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 120 00000100:00100000:2.0:1789584131.143257:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+8:18399:x1876514228557568:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789584131.143610:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+8:18399:x1876514228557568:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 354us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584131.143619:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 120 00000001:00080000:1.0:1789584131.146144:0:9074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1789584131.146168:0:9074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789584131.146174:0:9074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789584131.146180:0:9074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:0.0:1789584131.186323:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584131.190017:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228557696 00000100:00100000:2.0:1789584131.190034:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228557696 00000100:00100000:2.0:1789584131.190165:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 121 00000100:00100000:2.0:1789584131.190176:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+8:18399:x1876514228557696:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789584131.190538:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+8:18399:x1876514228557696:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 362us (4224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584131.190547:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 121 00000100:00100000:2.0:1789584131.203780:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584131.203937:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228557824 00000100:00100000:1.0:1789584131.203947:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228557824 00000100:00100000:1.0:1789584131.204006:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 122 00000100:00100000:1.0:1789584131.204018:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+8:18399:x1876514228557824:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789584131.204321:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+8:18399:x1876514228557824:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 305us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.204329:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 122 00000100:00100000:3.0:1789584131.211263:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584131.211491:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228557952 00000100:00100000:2.0:1789584131.211501:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228557952 00000100:00100000:2.0:1789584131.211558:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 123 00000100:00100000:2.0:1789584131.211568:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+8:18381:x1876514228557952:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789584131.211585:0:21939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584131.211604:0:21939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8e02047c00/0x113b6add9f869759 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee1dc expref: -99 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584131.211631:0:21939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8e02047c00/0x113b6add9f869759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee1dc expref: 9 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584131.211641:0:21939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8e02047c00/0x113b6add9f869759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee1dc expref: 9 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584131.211649:0:21939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8e02047c00, rc 0) 00000100:00100000:2.0:1789584131.211713:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+9:18381:x1876514228557952:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 147us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584131.211720:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 123 00000100:00100000:3.0:1789584131.230001:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584131.230181:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228558080 00000100:00100000:0.0:1789584131.230222:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228558080 00000100:00100000:0.0:1789584131.230341:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 124 00000100:00100000:0.0:1789584131.230352:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+9:18381:x1876514228558080:12345-192.168.204.11@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789584131.230380:0:21937:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789584131.230412:0:21937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789584131.230417:0:21937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789584131.230420:0:21937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789584131.230423:0:21937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789584131.230426:0:21937:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1789584131.234012:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+9:18381:x1876514228558080:12345-192.168.204.11@tcp:256:mount.lustre.0 Request processed in 3649us (4009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584131.234027:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 124 00000100:00100000:3.0:1789584131.242081:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584131.242182:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228558208 00000100:00100000:1.0:1789584131.242228:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228558208 00000100:00100000:1.0:1789584131.242295:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 125 00000100:00100000:1.0:1789584131.242306:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+9:18381:x1876514228558208:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789584131.242324:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584131.242342:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8ded95d400/0x113b6add9f869760 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee1e3 expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584131.242371:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8ded95d400/0x113b6add9f869760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee1e3 expref: 10 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584131.242403:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8ded95d400/0x113b6add9f869760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee1e3 expref: 10 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584131.242412:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8ded95d400, rc 0) 00000100:00100000:1.0:1789584131.242473:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+10:18381:x1876514228558208:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 170us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.242480:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 125 00000100:00100000:3.0:1789584131.246719:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584131.250944:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228558336 00000100:00100000:0.0:1789584131.250959:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228558336 00000100:00100000:1.0:1789584131.254990:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 126 00000100:00100000:1.0:1789584131.255011:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+10:18381:x1876514228558336:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789584131.255536:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+10:18381:x1876514228558336:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 531us (8826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.255546:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 126 00000100:00100000:3.0:1789584131.267146:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584131.269697:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228558464 00000100:00100000:2.0:1789584131.269714:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228558464 00000100:00100000:2.0:1789584131.269989:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 127 00000100:00100000:2.0:1789584131.270001:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+10:18381:x1876514228558464:12345-192.168.204.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789584131.270532:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+10:18381:x1876514228558464:12345-192.168.204.11@tcp:503:mount.lustre.0 Request processed in 533us (3395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584131.270543:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 127 00000100:00100000:3.0:1789584131.289610:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584131.290000:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228558592 00000100:00100000:1.0:1789584131.290010:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228558592 00000100:00100000:1.0:1789584131.290074:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 128 00000100:00100000:1.0:1789584131.290085:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+10:18404:x1876514228558592:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789584131.290448:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+10:18404:x1876514228558592:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 364us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.290456:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 128 00000040:00080000:2.0:1789584131.293110:0:22601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789584131.319504:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584131.319614:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228558720 00000100:00100000:0.0:1789584131.319650:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228558720 00000100:00100000:0.0:1789584131.319708:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 129 00000100:00100000:0.0:1789584131.319718:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+10:18404:x1876514228558720:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789584131.320017:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+10:18404:x1876514228558720:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 299us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584131.320026:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 129 00000100:00100000:3.0:1789584131.333539:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584131.333636:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584131.333638:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228558848 00000100:00100000:1.0:1789584131.333650:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228558848 00000100:00100000:1.0:1789584131.333701:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228559104 00000100:00100000:1.0:1789584131.333710:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228559104 00000100:00100000:1.0:1789584131.333726:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:1.0:1789584131.333741:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1876514228558848:12345-192.168.204.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789584131.333801:0:21946:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 319b0417-2da6-48eb-878f-de6e4d622177@192.168.204.11@tcp t0 exp 0000000000000000 cur 784 last 0 00000020:00000080:1.0:1789584131.333854:0:21946:0:(genops.c:1384:class_connect()) connect: client 319b0417-2da6-48eb-878f-de6e4d622177, cookie 0x113b6add9f869767 00000004:00100000:1.0:1789584131.333888:0:21946:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789584131.334366:0:21946:0:(import.c:65:import_set_state_nolock()) ffff8f8cc6caf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789584131.334449:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+6:2398:x1876514228558848:12345-192.168.204.11@tcp:38:mount.lustre.0 Request processed in 707us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.334458:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:1.0:1789584131.334481:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:1.0:1789584131.334486:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1876514228559104:12345-192.168.204.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789584131.334503:0:21946:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 319b0417-2da6-48eb-878f-de6e4d622177@192.168.204.11@tcp t0 exp 0000000000000000 cur 784 last 0 00000020:00000080:1.0:1789584131.334535:0:21946:0:(genops.c:1384:class_connect()) connect: client 319b0417-2da6-48eb-878f-de6e4d622177, cookie 0x113b6add9f86976e 00000004:00100000:1.0:1789584131.334552:0:21946:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789584131.334813:0:21946:0:(import.c:65:import_set_state_nolock()) ffff8f8cc5415800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789584131.334844:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+6:2398:x1876514228559104:12345-192.168.204.11@tcp:38:mount.lustre.0 Request processed in 356us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.334850:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:3.0:1789584131.340145:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584131.340317:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584131.345981:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584131.346063:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228559360 00000100:00100000:2.0:1789584131.346074:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228559360 00000100:00100000:2.0:1789584131.346149:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228558976 00000100:00100000:2.0:1789584131.346152:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228558976 00000100:00100000:2.0:1789584131.346166:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:2.0:1789584131.346174:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+7:18381:x1876514228559360:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789584131.346241:0:21945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789584131.346343:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+7:18381:x1876514228559360:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 168us (6208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584131.346351:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:2.0:1789584131.346372:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:2.0:1789584131.346378:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+6:0:x1876514228558976:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789584131.346389:0:21945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789584131.346413:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+6:0:x1876514228558976:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 35us (6096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584131.346436:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00080000:3.0:1789584131.348738:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789584131.348929:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228559232 00000100:00100000:0.0:1789584131.348941:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228559232 00000100:00100000:0.0:1789584131.348998:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:0.0:1789584131.349008:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+6:0:x1876514228559232:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789584131.349049:0:21947:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:1.0:1789584131.349302:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789584131.349828:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+6:0:x1876514228559232:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 818us (3857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584131.349838:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:2.0:1789584131.355969:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584131.358913:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228559488 00000100:00100000:1.0:1789584131.358929:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228559488 00000100:00100000:1.0:1789584131.359071:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:1.0:1789584131.359082:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+6:18381:x1876514228559488:12345-192.168.204.11@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789584131.359215:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+6:18381:x1876514228559488:12345-192.168.204.11@tcp:40:mount.lustre.0 Request processed in 108us (3232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584131.359223:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:0.0:1789584131.363588:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584131.365318:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228559872 00000100:00100000:3.0:1789584131.365333:0:21957:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228559872 00000100:00100000:3.0:1789584131.365396:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:3.0:1789584131.365405:0:21957:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:319b0417-2da6-48eb-878f-de6e4d622177+6:18381:x1876514228559872:12345-192.168.204.11@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789584131.365486:0:21957:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:319b0417-2da6-48eb-878f-de6e4d622177+6:18381:x1876514228559872:12345-192.168.204.11@tcp:900:mount.lustre.0 Request processed in 83us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584131.365494:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:3.0:1789584131.365566:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584131.365719:0:23258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228559616 00000100:00100000:0.0:1789584131.365737:0:23258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228559616 00000100:00100000:0.0:1789584131.365775:0:23258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:0.0:1789584131.365782:0:23258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1876514228559616:12345-192.168.204.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789584131.365808:0:23258:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 319b0417-2da6-48eb-878f-de6e4d622177@192.168.204.11@tcp t0 exp 0000000000000000 cur 784 last 0 00000020:00000080:0.0:1789584131.365840:0:23258:0:(genops.c:1384:class_connect()) connect: client 319b0417-2da6-48eb-878f-de6e4d622177, cookie 0x113b6add9f869775 00002000:00100000:0.0:1789584131.365851:0:23258:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 319b0417-2da6-48eb-878f-de6e4d622177/ffff8f8ded9e4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789584131.365862:0:23258:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789584131.366234:0:23258:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789584131.366298:0:23258:0:(import.c:65:import_set_state_nolock()) ffff8f8ded9e7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789584131.366336:0:23258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:319b0417-2da6-48eb-878f-de6e4d622177+6:2398:x1876514228559616:12345-192.168.204.11@tcp:8:mount.lustre.0 Request processed in 552us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584131.366343:0:23258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:0.0:1789584131.367958:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584131.368303:0:24195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228559744 00000100:00100000:3.0:1789584131.368314:0:24195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228559744 00000100:00100000:3.0:1789584131.368360:0:24195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:3.0:1789584131.368372:0:24195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1876514228559744:12345-192.168.204.11@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789584131.368406:0:24195:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 319b0417-2da6-48eb-878f-de6e4d622177@192.168.204.11@tcp t0 exp 0000000000000000 cur 784 last 0 00000020:00000080:3.0:1789584131.368436:0:24195:0:(genops.c:1384:class_connect()) connect: client 319b0417-2da6-48eb-878f-de6e4d622177, cookie 0x113b6add9f86977c 00002000:00100000:3.0:1789584131.368447:0:24195:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 319b0417-2da6-48eb-878f-de6e4d622177/ffff8f8cc4fb7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789584131.368470:0:24195:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789584131.369471:0:24195:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789584131.369512:0:24195:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4fb6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789584131.369591:0:24195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:319b0417-2da6-48eb-878f-de6e4d622177+6:2398:x1876514228559744:12345-192.168.204.11@tcp:8:mount.lustre.0 Request processed in 1221us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584131.369600:0:24195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:0.0:1789584131.374969:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584131.375660:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228560000 00000100:00100000:1.0:1789584131.375685:0:21948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228560000 00000100:00100000:1.0:1789584131.375869:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:1.0:1789584131.375880:0:21948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:319b0417-2da6-48eb-878f-de6e4d622177+6:18381:x1876514228560000:12345-192.168.204.11@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789584131.382832:0:21948:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6881us 00000004:00200000:2.0:1789584131.405563:0:21948:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789584131.405707:0:21948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:319b0417-2da6-48eb-878f-de6e4d622177+6:18381:x1876514228560000:12345-192.168.204.11@tcp:33:mount.lustre.0 Request processed in 29824us (30743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584131.405733:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:0.0:1789584131.629531:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584131.629633:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228560128 00000100:00100000:2.0:1789584131.629644:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228560128 00000100:00100000:2.0:1789584131.629711:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:2.0:1789584131.629722:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+6:18427:x1876514228560128:12345-192.168.204.11@tcp:101:mkdir.0 00010000:00010000:2.0:1789584131.629745:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584131.629769:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8e02046600/0x113b6add9f869783 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee214 expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584131.629839:0:21947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8e02046200/0x113b6add9f86978a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584131.629854:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8e02046200/0x113b6add9f86978a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584131.629868:0:21947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8e02046200/0x113b6add9f86978a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789584131.629903:0:21947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789584131.629907:0:21947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789584131.629958:0:21947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8e02046200/0x113b6add9f86978a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584131.629985:0:21947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8e02046600/0x113b6add9f869783 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee214 expref: 8 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584131.630029:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8e02046200/0x113b6add9f86978a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee214 expref: 7 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584131.630038:0:21947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8de236f000) 00010000:00010000:2.0:1789584131.630041:0:21947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789584131.630044:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8e02046200, rc 0) 00000100:00100000:2.0:1789584131.630114:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+7:18427:x1876514228560128:12345-192.168.204.11@tcp:101:mkdir.0 Request processed in 395us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584131.630121:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 13 00010000:00010000:3.0:1789584131.739449:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584132.763454:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584133.787525:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584133.858609:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584133.858703:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228560256 00000100:00100000:1.0:1789584133.858714:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228560256 00000100:00100000:1.0:1789584133.858796:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:1.0:1789584133.858808:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+7:18479:x1876514228560256:12345-192.168.204.11@tcp:41:lfs.0 00000004:00000024:1.0:1789584133.858856:0:21946:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1789584133.859160:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789584133.859378:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+7:18479:x1876514228560256:12345-192.168.204.11@tcp:41:lfs.0 Request processed in 571us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584133.859388:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:0.0:1789584133.880651:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584133.882335:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228560384 00000100:00100000:1.0:1789584133.882359:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228560384 00000100:00100000:1.0:1789584133.882578:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00100000:1.0:1789584133.882595:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+6:18479:x1876514228560384:12345-192.168.204.11@tcp:41:lfs.0 00000004:00000024:1.0:1789584133.882661:0:21945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789584133.883018:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+6:18479:x1876514228560384:12345-192.168.204.11@tcp:41:lfs.0 Request processed in 427us (2382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584133.883028:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00080000:3.0:1789584133.886962:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789584133.888000:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584133.888136:0:23260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228560512 00000100:00100000:2.0:1789584133.888150:0:23260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228560512 00000100:00100000:2.0:1789584133.888326:0:23260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:2.0:1789584133.888342:0:23260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:319b0417-2da6-48eb-878f-de6e4d622177+6:18479:x1876514228560512:12345-192.168.204.11@tcp:13:lfs.0 00002000:00000024:2.0:1789584133.888396:0:23260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789584133.888515:0:23260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:319b0417-2da6-48eb-878f-de6e4d622177+6:18479:x1876514228560512:12345-192.168.204.11@tcp:13:lfs.0 Request processed in 177us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584133.888523:0:23260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00080000:3.0:1789584133.889167:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789584133.896745:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584133.896929:0:23260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228560640 00000100:00100000:2.0:1789584133.896944:0:23260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228560640 00000100:00100000:2.0:1789584133.897036:0:23260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:2.0:1789584133.897051:0:23260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:319b0417-2da6-48eb-878f-de6e4d622177+6:18479:x1876514228560640:12345-192.168.204.11@tcp:13:lfs.0 00002000:00000024:2.0:1789584133.897105:0:23260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789584133.897265:0:23260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:319b0417-2da6-48eb-878f-de6e4d622177+6:18479:x1876514228560640:12345-192.168.204.11@tcp:13:lfs.0 Request processed in 217us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584133.897296:0:23260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00080000:3.0:1789584133.897490:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789584134.108791:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584134.108926:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228560768 00000100:00100000:2.0:1789584134.108942:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228560768 00000100:00100000:2.0:1789584134.109024:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 130 00000100:00100000:2.0:1789584134.109037:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+10:18509:x1876514228560768:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789584134.109061:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584134.109086:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8e02046600/0x113b6add9f869791 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee21b expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584134.109126:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8e02046600/0x113b6add9f869791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee21b expref: 11 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584134.109140:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8e02046600/0x113b6add9f869791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee21b expref: 11 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584134.109151:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8e02046600, rc 0) 00000100:00100000:2.0:1789584134.109284:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+11:18509:x1876514228560768:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 250us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584134.109292:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 130 00000100:00100000:0.0:1789584134.115450:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584134.115915:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228560896 00000100:00100000:2.0:1789584134.115929:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228560896 00000100:00100000:2.0:1789584134.116075:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 131 00000100:00100000:2.0:1789584134.116089:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+11:18509:x1876514228560896:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789584134.116567:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+11:18509:x1876514228560896:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 470us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584134.116576:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 131 00000100:00100000:0.0:1789584134.121251:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584134.124752:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228561024 00000100:00100000:1.0:1789584134.124773:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228561024 00000100:00100000:1.0:1789584134.124853:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 132 00000100:00100000:1.0:1789584134.124866:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+11:18509:x1876514228561024:12345-192.168.204.11@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789584134.129058:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+11:18509:x1876514228561024:12345-192.168.204.11@tcp:503:mount.lustre.0 Request processed in 4172us (7799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584134.129243:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 132 00000100:00100000:3.0:1789584134.140822:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584134.140902:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228561152 00000100:00100000:2.0:1789584134.140917:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228561152 00000100:00100000:2.0:1789584134.140990:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 133 00000100:00100000:2.0:1789584134.141003:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+11:18517:x1876514228561152:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789584134.141506:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+11:18517:x1876514228561152:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 503us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584134.141523:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 133 00000100:00100000:0.0:1789584134.171342:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584134.171443:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228561280 00000100:00100000:3.0:1789584134.171457:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228561280 00000100:00100000:3.0:1789584134.171535:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 134 00000100:00100000:3.0:1789584134.171547:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+11:18517:x1876514228561280:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789584134.174442:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+11:18517:x1876514228561280:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 2878us (3097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584134.174464:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 134 00000100:00100000:0.0:1789584134.183156:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584134.183314:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228561408 00000100:00100000:3.0:1789584134.183331:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228561408 00000100:00100000:3.0:1789584134.183413:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 135 00000100:00100000:3.0:1789584134.183425:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+11:18517:x1876514228561408:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789584134.183864:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+11:18517:x1876514228561408:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 437us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584134.183888:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 135 00000100:00100000:0.0:1789584134.197345:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584134.197501:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228561536 00000100:00100000:3.0:1789584134.197515:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228561536 00000100:00100000:3.0:1789584134.197607:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 136 00000100:00100000:3.0:1789584134.197619:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+11:18509:x1876514228561536:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789584134.197642:0:21937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789584134.197668:0:21937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8df4fe8000/0x113b6add9f869798 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee24c expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584134.197716:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8df4fe8000/0x113b6add9f869798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee24c expref: 12 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584134.197728:0:21937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8df4fe8000/0x113b6add9f869798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee24c expref: 12 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584134.197739:0:21937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8df4fe8000, rc 0) 00000100:00100000:3.0:1789584134.198320:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+12:18509:x1876514228561536:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 698us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584134.198330:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 136 00000100:00100000:0.0:1789584134.208789:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584134.208865:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228561664 00000100:00100000:3.0:1789584134.208880:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228561664 00000100:00100000:3.0:1789584134.208951:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 137 00000100:00100000:3.0:1789584134.208964:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+12:18509:x1876514228561664:12345-192.168.204.11@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789584134.209001:0:21939:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789584134.209037:0:21939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789584134.209042:0:21939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789584134.209045:0:21939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789584134.209061:0:21939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789584134.209063:0:21939:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1789584134.218533:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+12:18509:x1876514228561664:12345-192.168.204.11@tcp:256:mount.lustre.0 Request processed in 9549us (9736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584134.218561:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 137 00000100:00100000:0.0:1789584134.230177:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584134.231171:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228561792 00000100:00100000:3.0:1789584134.231235:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228561792 00000100:00100000:2.0:1789584134.231796:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 138 00000100:00100000:2.0:1789584134.231814:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+12:18509:x1876514228561792:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789584134.231840:0:21937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584134.231871:0:21937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8e02047000/0x113b6add9f86979f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee253 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584134.231909:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8e02047000/0x113b6add9f86979f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee253 expref: 13 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584134.231923:0:21937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8e02047000/0x113b6add9f86979f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee253 expref: 13 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584134.231932:0:21937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8e02047000, rc 0) 00000100:00100000:2.0:1789584134.232022:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+13:18509:x1876514228561792:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 213us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584134.232030:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 138 00000100:00100000:0.0:1789584134.236788:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584134.236937:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228561920 00000100:00100000:3.0:1789584134.236950:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228561920 00000100:00100000:3.0:1789584134.237031:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 139 00000100:00100000:3.0:1789584134.237044:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+13:18509:x1876514228561920:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789584134.237515:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+13:18509:x1876514228561920:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 473us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584134.237524:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 139 00000100:00100000:0.0:1789584134.239777:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584134.240051:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228562048 00000100:00100000:3.0:1789584134.240065:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228562048 00000100:00100000:3.0:1789584134.244529:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 140 00000100:00100000:3.0:1789584134.244887:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+13:18509:x1876514228562048:12345-192.168.204.11@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789584134.245836:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+13:18509:x1876514228562048:12345-192.168.204.11@tcp:503:mount.lustre.0 Request processed in 1279us (6062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584134.245851:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 140 00000100:00100000:0.0:1789584134.252509:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584134.252919:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228562176 00000100:00100000:2.0:1789584134.252934:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228562176 00000100:00100000:2.0:1789584134.253093:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 141 00000100:00100000:2.0:1789584134.253106:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+13:18523:x1876514228562176:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789584134.253508:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+13:18523:x1876514228562176:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 403us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584134.253517:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 141 00000100:00100000:0.0:1789584134.260305:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584134.263500:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228562304 00000100:00100000:3.0:1789584134.263523:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228562304 00000100:00100000:3.0:1789584134.263964:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 142 00000100:00100000:3.0:1789584134.263978:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+13:18523:x1876514228562304:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789584134.264430:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+13:18523:x1876514228562304:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 454us (4140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584134.264450:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 142 00000100:00100000:0.0:1789584134.278043:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584134.278873:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228562432 00000100:00100000:1.0:1789584134.278890:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228562432 00000100:00100000:1.0:1789584134.279041:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:1.0:1789584134.279054:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1876514228562432:12345-192.168.204.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789584134.279100:0:21946:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e2408ec3-193f-4ced-b3de-620548852bdb@192.168.204.11@tcp t0 exp 0000000000000000 cur 787 last 0 00000020:00000080:1.0:1789584134.279152:0:21946:0:(genops.c:1384:class_connect()) connect: client e2408ec3-193f-4ced-b3de-620548852bdb, cookie 0x113b6add9f8697a6 00000004:00100000:1.0:1789584134.279221:0:21946:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789584134.279403:0:21946:0:(import.c:65:import_set_state_nolock()) ffff8f8deda90000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789584134.279570:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584134.279691:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2408ec3-193f-4ced-b3de-620548852bdb+6:2398:x1876514228562432:12345-192.168.204.11@tcp:38:mount.lustre.0 Request processed in 637us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584134.279701:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:1.0:1789584134.285918:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228562688 00000100:00100000:1.0:1789584134.285940:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228562688 00000100:00100000:1.0:1789584134.285996:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:1.0:1789584134.286007:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1876514228562688:12345-192.168.204.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789584134.286060:0:21946:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from e2408ec3-193f-4ced-b3de-620548852bdb@192.168.204.11@tcp t0 exp 0000000000000000 cur 787 last 0 00000020:00000080:1.0:1789584134.286127:0:21946:0:(genops.c:1384:class_connect()) connect: client e2408ec3-193f-4ced-b3de-620548852bdb, cookie 0x113b6add9f8697ad 00000004:00100000:1.0:1789584134.286173:0:21946:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789584134.286372:0:21946:0:(import.c:65:import_set_state_nolock()) ffff8f8deda97800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789584134.286460:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2408ec3-193f-4ced-b3de-620548852bdb+6:2398:x1876514228562688:12345-192.168.204.11@tcp:38:mount.lustre.0 Request processed in 453us (6890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584134.286469:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:0.0:1789584134.295285:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584134.295325:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584134.295489:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228562560 00000100:00100000:2.0:1789584134.295504:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228562560 00000100:00100000:2.0:1789584134.295611:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228562944 00000100:00100000:2.0:1789584134.295615:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228562944 00000100:00100000:2.0:1789584134.295641:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:2.0:1789584134.295654:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2408ec3-193f-4ced-b3de-620548852bdb+7:0:x1876514228562560:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789584134.295698:0:21947:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789584134.295793:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2408ec3-193f-4ced-b3de-620548852bdb+7:0:x1876514228562560:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 141us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584134.295801:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:2.0:1789584134.295824:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:2.0:1789584134.295832:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2408ec3-193f-4ced-b3de-620548852bdb+6:18509:x1876514228562944:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789584134.295844:0:21947:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789584134.295878:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2408ec3-193f-4ced-b3de-620548852bdb+6:18509:x1876514228562944:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 47us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584134.295884:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:0.0:1789584134.296887:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00080000:3.0:1789584134.296949:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789584134.297459:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228562816 00000100:00100000:1.0:1789584134.297472:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228562816 00000100:00080000:3.0:1789584134.297530:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789584134.297785:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:1.0:1789584134.297797:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2408ec3-193f-4ced-b3de-620548852bdb+6:0:x1876514228562816:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789584134.297834:0:21947:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789584134.297930:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2408ec3-193f-4ced-b3de-620548852bdb+6:0:x1876514228562816:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 135us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584134.297939:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:0.0:1789584134.299842:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584134.300092:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228563072 00000100:00100000:2.0:1789584134.300104:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228563072 00000100:00100000:2.0:1789584134.300159:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:2.0:1789584134.300171:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2408ec3-193f-4ced-b3de-620548852bdb+6:18509:x1876514228563072:12345-192.168.204.11@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789584134.300308:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2408ec3-193f-4ced-b3de-620548852bdb+6:18509:x1876514228563072:12345-192.168.204.11@tcp:40:mount.lustre.0 Request processed in 139us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584134.300340:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:0.0:1789584134.312363:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584134.312497:0:23759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228563200 00000100:00100000:3.0:1789584134.312511:0:23759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228563200 00000100:00100000:3.0:1789584134.312634:0:23759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:3.0:1789584134.312647:0:23759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1876514228563200:12345-192.168.204.11@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789584134.312712:0:23759:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e2408ec3-193f-4ced-b3de-620548852bdb@192.168.204.11@tcp t0 exp 0000000000000000 cur 787 last 0 00000020:00000080:3.0:1789584134.312757:0:23759:0:(genops.c:1384:class_connect()) connect: client e2408ec3-193f-4ced-b3de-620548852bdb, cookie 0x113b6add9f8697b4 00002000:00100000:3.0:1789584134.312773:0:23759:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e2408ec3-193f-4ced-b3de-620548852bdb/ffff8f8cc4fb1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789584134.312789:0:23759:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789584134.312940:0:23759:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789584134.312985:0:23759:0:(import.c:65:import_set_state_nolock()) ffff8f8cc4fb2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789584134.313095:0:23759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2408ec3-193f-4ced-b3de-620548852bdb+6:2398:x1876514228563200:12345-192.168.204.11@tcp:8:mount.lustre.0 Request processed in 449us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584134.313104:0:23759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:2.0:1789584134.313243:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584134.316293:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584134.316343:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228563456 00000100:00100000:2.0:1789584134.316355:0:21957:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228563456 00000100:00100000:2.0:1789584134.316424:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:2.0:1789584134.316437:0:21957:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e2408ec3-193f-4ced-b3de-620548852bdb+6:18509:x1876514228563456:12345-192.168.204.11@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789584134.316540:0:21957:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e2408ec3-193f-4ced-b3de-620548852bdb+6:18509:x1876514228563456:12345-192.168.204.11@tcp:900:mount.lustre.0 Request processed in 106us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584134.316549:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:1.0:1789584134.316827:0:23258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228563328 00000100:00100000:1.0:1789584134.316834:0:23258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228563328 00000100:00100000:1.0:1789584134.316867:0:23258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:1.0:1789584134.316873:0:23258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df781a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1876514228563328:12345-192.168.204.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789584134.316923:0:23258:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e2408ec3-193f-4ced-b3de-620548852bdb@192.168.204.11@tcp t0 exp 0000000000000000 cur 787 last 0 00000020:00000080:1.0:1789584134.316967:0:23258:0:(genops.c:1384:class_connect()) connect: client e2408ec3-193f-4ced-b3de-620548852bdb, cookie 0x113b6add9f8697bb 00002000:00100000:1.0:1789584134.316983:0:23258:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e2408ec3-193f-4ced-b3de-620548852bdb/ffff8f8deda93000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789584134.316998:0:23258:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789584134.317131:0:23258:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789584134.317170:0:23258:0:(import.c:65:import_set_state_nolock()) ffff8f8deda93800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789584134.317243:0:23258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df781a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2408ec3-193f-4ced-b3de-620548852bdb+6:2398:x1876514228563328:12345-192.168.204.11@tcp:8:mount.lustre.0 Request processed in 368us (4000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584134.317251:0:23258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:0.0:1789584134.320782:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584134.324789:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228563584 00000100:00100000:1.0:1789584134.324810:0:21949:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228563584 00000100:00100000:1.0:1789584134.324899:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:1.0:1789584134.324912:0:21949:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2408ec3-193f-4ced-b3de-620548852bdb+6:18509:x1876514228563584:12345-192.168.204.11@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789584134.325293:0:21949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789584134.326169:0:21949:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2408ec3-193f-4ced-b3de-620548852bdb+6:18509:x1876514228563584:12345-192.168.204.11@tcp:33:mount.lustre.0 Request processed in 1252us (5397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584134.326254:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:1.0:1789584134.489084:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584134.489645:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228563712 00000100:00100000:2.0:1789584134.489661:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228563712 00000100:00100000:2.0:1789584134.489856:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:2.0:1789584134.489869:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2408ec3-193f-4ced-b3de-620548852bdb+6:18546:x1876514228563712:12345-192.168.204.11@tcp:101:mkdir.0 00010000:00010000:2.0:1789584134.489900:0:21945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584134.489934:0:21945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8e02047800/0x113b6add9f8697c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee284 expref: -99 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584134.490034:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f8697c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584134.490050:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f8697c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584134.490065:0:21945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f8697c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789584134.490145:0:21945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789584134.490150:0:21945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789584134.490177:0:21945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f8697c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584134.490248:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8e02047800/0x113b6add9f8697c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee284 expref: 8 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584134.490276:0:21945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f8697c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee284 expref: 7 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584134.490288:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8de236f000) 00010000:00010000:2.0:1789584134.490291:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789584134.490296:0:21945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8dc4c60a00, rc 0) 00000100:00100000:2.0:1789584134.490390:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2408ec3-193f-4ced-b3de-620548852bdb+7:18546:x1876514228563712:12345-192.168.204.11@tcp:101:mkdir.0 Request processed in 524us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584134.490397:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 22 00010000:00010000:3.0:1789584134.811511:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584135.131376:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789584135.131404:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253854976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789584135.131486:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584135.131783:0:23260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253854976 00000100:00100000:2.0:1789584135.131794:0:23260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253854976 00000100:00100000:2.0:1789584135.131864:0:23260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789584135.131876:0:23260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253854976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789584135.131900:0:23260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789584135.131954:0:23260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253854976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584135.131962:0:23260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789584135.132018:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253854976:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789584135.132161:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789584135.145350:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253855104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789584135.145426:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584135.145538:0:23260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253855104 00000100:00100000:3.0:1789584135.145556:0:23260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253855104 00000100:00100000:3.0:1789584135.145623:0:23260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789584135.145633:0:23260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df7819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253855104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789584135.146135:0:23260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789584135.146224:0:23260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df7819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253855104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 556us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584135.146232:0:23260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789584135.146319:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789584135.146368:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253855104:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1789584135.196021:0:8131:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 319b0417-2da6-48eb-878f-de6e4d622177 00000001:00100000:0.0:1789584135.196128:0:8131:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e2408ec3-193f-4ced-b3de-620548852bdb 00000100:00100000:3.0:1789584135.645774:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789584135.645796:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253855232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789584135.645862:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584135.645916:0:21950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253855232 00000100:00100000:3.0:1789584135.645923:0:21950:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253855232 00000100:00100000:3.0:1789584135.645964:0:21950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789584135.645973:0:21950:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253855232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789584135.646012:0:21950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789584135.646056:0:21950:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253855232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584135.646063:0:21950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789584135.646102:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253855232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789584135.647096:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789584135.647111:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253855360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789584135.647155:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584135.647340:0:22867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253855360 00000100:00100000:3.0:1789584135.647346:0:22867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253855360 00000100:00100000:3.0:1789584135.647377:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789584135.647385:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253855360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789584135.647412:0:22867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789584135.647465:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253855360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584135.647472:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789584135.647508:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253855360:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789584135.838533:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789584136.155667:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789584136.155693:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253855488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789584136.155765:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584136.156315:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789584136.156327:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253855616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789584136.156359:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584136.158020:0:23259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253855488 00000100:00100000:2.0:1789584136.158032:0:23259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253855488 00000100:00100000:2.0:1789584136.158090:0:23259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253855616 00000100:00100000:2.0:1789584136.158093:0:23259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253855616 00000100:00100000:2.0:1789584136.158112:0:23259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789584136.158121:0:23259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253855488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789584136.158155:0:23259:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789584136.159032:0:3455:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1789584136.159059:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253855488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789584136.159603:0:23259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253855488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1481us (3836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584136.160909:0:23259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789584136.160944:0:23259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789584136.160958:0:23259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253855616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789584136.160980:0:23259:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789584136.161044:0:23259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253855616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (4683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584136.161050:0:23259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789584136.161101:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253855872:0@lo:400:kworker.0 00000100:00100000:2.0:1789584136.161138:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584136.161217:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253856384:0@lo:400:kworker.0 00000100:00100000:2.0:1789584136.161243:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584136.161262:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3457:1876514253856896:0@lo:400:kworker.0 00000100:00100000:2.0:1789584136.161285:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584136.161307:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789584136.161315:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3457:1876514253855744:0@lo:400:kworker.0 00000100:00100000:2.0:1789584136.161341:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584136.161360:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253856256:0@lo:400:kworker.0 00000100:00100000:2.0:1789584136.161380:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584136.161397:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3457:1876514253856768:0@lo:400:kworker.0 00000100:00100000:2.0:1789584136.161416:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584136.161465:0:24195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253856384 00000100:00100000:1.0:1789584136.163251:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253855872 00000100:00100000:1.0:1789584136.163262:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253855872 00000100:00100000:1.0:1789584136.163305:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253856256 00000100:00100000:1.0:1789584136.163308:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253856256 00000100:00100000:1.0:1789584136.163324:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789584136.163333:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253855872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.163408:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253855872:12345-0@lo:400:kworker.0 Request processed in 76us (2269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584136.163415:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789584136.163430:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789584136.163436:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253856256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.163463:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253856256:12345-0@lo:400:kworker.0 Request processed in 27us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584136.163468:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789584136.163552:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253856256:0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.163576:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253855872:0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.163614:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253856896 00000100:00100000:1.0:1789584136.163618:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253856896 00000100:00100000:1.0:1789584136.163651:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253856768 00000100:00100000:1.0:1789584136.163654:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253856768 00000100:00100000:1.0:1789584136.163666:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789584136.163672:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3457:x1876514253856896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.163706:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3457:x1876514253856896:12345-0@lo:400:kworker.0 Request processed in 34us (2420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584136.163711:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789584136.163723:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789584136.163728:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3457:x1876514253856768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.163753:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3457:x1876514253856768:12345-0@lo:400:kworker.0 Request processed in 25us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584136.163758:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789584136.163778:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253855744 00000100:00100000:1.0:1789584136.163781:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253855744 00000100:00100000:1.0:1789584136.163804:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789584136.163810:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:3457:x1876514253855744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.163838:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:3457:x1876514253855744:12345-0@lo:400:kworker.0 Request processed in 29us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584136.163844:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789584136.163878:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3457:1876514253855744:0@lo:400:kworker.0 00010000:00080000:1.0:1789584136.163898:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dc4c5ed80 x1876514253856768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584136.163921:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3457:1876514253856768:0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.163935:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3457:1876514253856896:0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.163980:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253856000:0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.164012:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584136.164033:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876514253856512:0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.164052:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584136.164067:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3454:1876514253857024:0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.164088:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584136.164107:0:3454:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1789584136.164124:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253855616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789584136.164136:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789584136.164142:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3454:1876514253856128:0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.164162:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584136.164172:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3454:1876514253856640:0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.164231:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584136.164251:0:23258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253856000 00000100:00100000:1.0:1789584136.164255:0:23258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253856000 00000100:00100000:1.0:1789584136.164281:0:23258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789584136.164288:0:23258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253856000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.164323:0:23258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253856000:12345-0@lo:400:kworker.0 Request processed in 35us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584136.164328:0:23258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789584136.164345:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253856512 00000100:00100000:1.0:1789584136.164356:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253856512 00000100:00100000:1.0:1789584136.164371:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253857024 00000100:00100000:1.0:1789584136.164373:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253857024 00000100:00100000:1.0:1789584136.164384:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253856128 00000100:00100000:1.0:1789584136.164386:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253856128 00000100:00100000:1.0:1789584136.164394:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253856640 00000100:00100000:1.0:1789584136.164396:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253856640 00000100:00100000:1.0:1789584136.164406:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789584136.164411:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876514253856512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.164440:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876514253856512:12345-0@lo:400:kworker.0 Request processed in 28us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584136.164445:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789584136.164457:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789584136.164462:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3454:x1876514253857024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.164485:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3454:x1876514253857024:12345-0@lo:400:kworker.0 Request processed in 23us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584136.164490:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789584136.164501:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789584136.164506:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3454:x1876514253856128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.164529:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3454:x1876514253856128:12345-0@lo:400:kworker.0 Request processed in 23us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584136.164533:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789584136.164542:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789584136.164547:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc44a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3454:x1876514253856640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.164572:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc44a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3454:x1876514253856640:12345-0@lo:400:kworker.0 Request processed in 26us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584136.164577:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789584136.164615:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3454:1876514253856128:0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.164624:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3454:1876514253856640:0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.164633:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253856000:0@lo:400:kworker.0 00000100:00100000:1.0:1789584136.164641:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876514253856512:0@lo:400:kworker.0 00010000:00080000:1.0:1789584136.164652:0:3454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dfce5ed80 x1876514253857024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789584136.164660:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3454:1876514253857024:0@lo:400:kworker.0 00000100:00100000:2.0:1789584136.165052:0:24195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253856384 00000100:00100000:2.0:1789584136.165094:0:24195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789584136.165101:0:24195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8defc75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253856384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584136.165142:0:24195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8defc75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253856384:12345-0@lo:400:kworker.0 Request processed in 42us (3898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584136.165148:0:24195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789584136.165200:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253856384:0@lo:400:kworker.0 00000100:00080000:0.0:1789584136.165345:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789584136.165350:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789584136.165353:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1789584136.266750:0:7262:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e2408ec3-193f-4ced-b3de-620548852bdb 00000001:00100000:0.0:1789584136.266766:0:7262:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 319b0417-2da6-48eb-878f-de6e4d622177 00000001:00100000:1.0:1789584136.269446:0:9074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e2408ec3-193f-4ced-b3de-620548852bdb 00000001:00100000:1.0:1789584136.269463:0:9074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 319b0417-2da6-48eb-878f-de6e4d622177 00000001:00100000:1.0:1789584136.343495:0:6470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e2408ec3-193f-4ced-b3de-620548852bdb 00000001:00100000:1.0:1789584136.343510:0:6470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 319b0417-2da6-48eb-878f-de6e4d622177 00010000:00010000:1.0:1789584136.866128:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789584137.247841:0:21981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1789584137.747762:0:24543:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789584137.886589:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789584138.908130:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584139.409688:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584139.409747:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584139.409783:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584139.409833:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584139.409851:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584139.409873:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584139.409893:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584139.409911:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584139.409947:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584139.409987:0:23759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228564352 00000100:00100000:3.0:1789584139.410000:0:23759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228564352 00000100:00100000:3.0:1789584139.410086:0:23759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228564864 00000100:00100000:3.0:1789584139.410089:0:23759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228564864 00000100:00100000:3.0:1789584139.410106:0:23759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228564224 00000100:00100000:3.0:1789584139.410109:0:23759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228564224 00000100:00100000:3.0:1789584139.410135:0:23759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228564736 00000100:00100000:3.0:1789584139.410138:0:23759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228564736 00000100:00100000:3.0:1789584139.410155:0:23759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:3.0:1789584139.410170:0:23759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:319b0417-2da6-48eb-878f-de6e4d622177+5:2402:x1876514228564352:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1789584139.410384:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228563840 00000100:00100000:1.0:1789584139.410390:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228563840 00000100:00100000:1.0:1789584139.410425:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 144 00000100:00100000:1.0:1789584139.410434:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+13:2402:x1876514228563840:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1789584139.410530:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+13:2402:x1876514228563840:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 97us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584139.410539:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 144 00000100:00100000:1.0:1789584139.410649:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228564096 00000100:00100000:1.0:1789584139.410654:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228564096 00000100:00100000:1.0:1789584139.410680:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228564608 00000100:00100000:1.0:1789584139.410683:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228564608 00000100:00100000:1.0:1789584139.410694:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228563968 00000100:00100000:1.0:1789584139.410709:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228563968 00000100:00100000:1.0:1789584139.410727:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228564480 00000100:00100000:1.0:1789584139.410729:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228564480 00000100:00100000:1.0:1789584139.410746:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 38 00000100:00100000:1.0:1789584139.410752:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+5:2402:x1876514228564096:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1789584139.410788:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+5:2402:x1876514228564096:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 35us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584139.410796:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 38 00000100:00100000:1.0:1789584139.410809:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:1.0:1789584139.410814:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2408ec3-193f-4ced-b3de-620548852bdb+5:2402:x1876514228564608:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1789584139.410838:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2408ec3-193f-4ced-b3de-620548852bdb+5:2402:x1876514228564608:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 23us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584139.410844:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:1.0:1789584139.410856:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:1.0:1789584139.410862:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+6:2402:x1876514228563968:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1789584139.410888:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+6:2402:x1876514228563968:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 25us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584139.410893:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:1.0:1789584139.410903:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 41 00000100:00100000:1.0:1789584139.410909:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2408ec3-193f-4ced-b3de-620548852bdb+6:2402:x1876514228564480:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1789584139.410934:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2408ec3-193f-4ced-b3de-620548852bdb+6:2402:x1876514228564480:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 26us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584139.410940:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 41 00000100:00100000:0.0:1789584139.411398:0:23257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:0.0:1789584139.411411:0:23257:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2408ec3-193f-4ced-b3de-620548852bdb+5:2402:x1876514228564864:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1789584139.411448:0:23257:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2408ec3-193f-4ced-b3de-620548852bdb+5:2402:x1876514228564864:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 42us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584139.411455:0:23257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:0.0:1789584139.411474:0:23257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:0.0:1789584139.411481:0:23257:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:319b0417-2da6-48eb-878f-de6e4d622177+5:2402:x1876514228564224:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1789584139.411506:0:23257:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:319b0417-2da6-48eb-878f-de6e4d622177+5:2402:x1876514228564224:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 25us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584139.411512:0:23257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:0.0:1789584139.411535:0:23257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:0.0:1789584139.411541:0:23257:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2408ec3-193f-4ced-b3de-620548852bdb+5:2402:x1876514228564736:12345-192.168.204.11@tcp:400:kworker.0 00000100:00080000:2.0:1789584139.411860:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789584139.411868:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789584139.411871:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789584139.411873:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789584139.412429:0:23257:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2408ec3-193f-4ced-b3de-620548852bdb+5:2402:x1876514228564736:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 27us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584139.412445:0:23257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:3.0:1789584139.423862:0:23759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:319b0417-2da6-48eb-878f-de6e4d622177+5:2402:x1876514228564352:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 13670us (14052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584139.423882:0:23759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 8 00010000:00010000:1.0:1789584139.945948:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584140.251822:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253857152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789584140.251928:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584140.252026:0:23260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253857152 00000100:00100000:3.0:1789584140.252035:0:23260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253857152 00000100:00100000:3.0:1789584140.252117:0:23260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789584140.252129:0:23260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253857152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789584140.252174:0:23260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789584140.252257:0:23260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253857152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584140.252284:0:23260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789584140.252342:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253857152:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789584140.253866:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789584140.256080:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253857280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789584140.256220:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584140.256371:0:23260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253857280 00000100:00100000:0.0:1789584140.256383:0:23260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253857280 00000100:00100000:0.0:1789584140.256469:0:23260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789584140.256481:0:23260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253857280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789584140.256514:0:23260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789584140.256587:0:23260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253857280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584140.256595:0:23260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789584140.259312:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789584140.268374:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253857280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789584140.763687:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253857536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789584140.763795:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584140.764029:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253857536 00000100:00100000:0.0:1789584140.764042:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253857536 00000100:00100000:0.0:1789584140.764129:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789584140.764141:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253857536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789584140.764231:0:21951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789584140.764294:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253857536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584140.764302:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789584140.764996:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789584140.765018:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253857408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789584140.765079:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584140.765148:0:22867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253857408 00000100:00100000:2.0:1789584140.765154:0:22867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253857408 00000100:00100000:2.0:1789584140.765218:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789584140.765229:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253857408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789584140.765267:0:22867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789584140.765317:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253857408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584140.765323:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789584140.765380:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253857408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789584140.765900:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253857536:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789584140.955586:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584141.279512:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253857664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789584141.279600:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253857920:0@lo:400:kworker.0 00000100:00100000:3.0:1789584141.279644:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584141.281414:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dc4c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3456:1876514253857792:0@lo:400:kworker.0 00000100:00100000:2.0:1789584141.283603:0:23260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253857664 00000100:00100000:2.0:1789584141.283619:0:23260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253857664 00000100:00100000:2.0:1789584141.283680:0:23260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789584141.283692:0:23260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253857664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789584141.283727:0:23260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789584141.285147:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584141.285217:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df7819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253858432:0@lo:400:kworker.0 00000100:00100000:1.0:1789584141.285263:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584141.285279:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3457:1876514253858944:0@lo:400:kworker.0 00000100:00100000:1.0:1789584141.285299:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584141.285349:0:23255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253857920 00000100:00100000:1.0:1789584141.285355:0:23255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253857920 00000100:00100000:1.0:1789584141.285392:0:23255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253858432 00000100:00100000:1.0:1789584141.285394:0:23255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253858432 00000100:00100000:1.0:1789584141.285418:0:23255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789584141.285439:0:23255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253857920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584141.285593:0:23257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789584141.285601:0:23257:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3457:x1876514253858432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584141.285638:0:23257:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3457:x1876514253858432:12345-0@lo:400:kworker.0 Request processed in 38us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584141.285657:0:23257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789584141.285842:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876514253858176:0@lo:400:kworker.0 00000100:00100000:3.0:1789584141.285989:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584141.286030:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3455:1876514253858688:0@lo:400:kworker.0 00000100:00100000:3.0:1789584141.286072:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584141.286116:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253859200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789584141.286140:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584141.286162:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584141.286240:0:23259:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1789584141.286251:0:23259:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1789584141.286255:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789584141.286268:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253858048:0@lo:400:kworker.0 00000100:00100000:3.0:1789584141.286304:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584141.286345:0:23759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253858048 00000100:00100000:3.0:1789584141.286353:0:23759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253858048 00000100:00100000:0.0:1789584141.286377:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dff9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253858304:0@lo:400:kworker.0 00000100:00100000:3.0:1789584141.286424:0:23759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789584141.286439:0:23759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253858048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584141.286460:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584141.286491:0:23257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253858304 00000100:00100000:0.0:1789584141.286497:0:23257:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253858304 00000100:00100000:3.0:1789584141.286510:0:23759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253858048:12345-0@lo:400:kworker.0 Request processed in 74us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584141.286519:0:23759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789584141.287417:0:23257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789584141.287503:0:23257:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253858304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584141.287579:0:23257:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253858304:12345-0@lo:400:kworker.0 Request processed in 82us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584141.287585:0:23257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789584141.287983:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253858304:0@lo:400:kworker.0 00000100:00100000:0.0:1789584141.287993:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253858816:0@lo:400:kworker.0 00000100:00100000:3.0:1789584141.288025:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253858048:0@lo:400:kworker.0 00000100:00100000:3.0:1789584141.288051:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876514253858560:0@lo:400:kworker.0 00000100:00100000:3.0:1789584141.288118:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584141.288142:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3455:1876514253859072:0@lo:400:kworker.0 00000100:00100000:3.0:1789584141.288171:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584141.288338:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584141.288404:0:23259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253859200 00000100:00100000:0.0:1789584141.288410:0:23259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253859200 00000100:00100000:0.0:1789584141.289234:0:24655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789584141.289246:0:24655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253859200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789584141.289267:0:24655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789584141.289321:0:24655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253859200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (3162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584141.289327:0:24655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789584141.289370:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253859200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789584141.290252:0:23260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253857664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6558us (10605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584141.290263:0:23260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789584141.290295:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789584141.290311:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253858944 00000100:00100000:2.0:1789584141.290318:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253858944 00000100:00100000:2.0:1789584141.290351:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253858176 00000100:00100000:2.0:1789584141.290354:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253858176 00000100:00100000:2.0:1789584141.290367:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253858688 00000100:00100000:2.0:1789584141.290371:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253858688 00000100:00100000:2.0:1789584141.290398:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253858560 00000100:00100000:2.0:1789584141.290401:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253858560 00000100:00100000:2.0:1789584141.290412:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253859072 00000100:00100000:2.0:1789584141.290415:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253859072 00000100:00100000:2.0:1789584141.290441:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253858816 00000100:00100000:2.0:1789584141.290444:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253858816 00000100:00100000:2.0:1789584141.290457:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789584141.290463:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3457:x1876514253858944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584141.290506:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3457:x1876514253858944:12345-0@lo:400:kworker.0 Request processed in 43us (5206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584141.290513:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789584141.290525:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789584141.290530:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876514253858176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584141.290571:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876514253858176:12345-0@lo:400:kworker.0 Request processed in 41us (4583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584141.290577:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789584141.290589:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789584141.290595:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876514253858688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584141.290623:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876514253858688:12345-0@lo:400:kworker.0 Request processed in 29us (4557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584141.290629:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789584141.290640:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789584141.290645:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876514253858560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584141.290672:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876514253858560:12345-0@lo:400:kworker.0 Request processed in 27us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584141.290677:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789584141.290688:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789584141.290702:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876514253859072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584141.290727:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876514253859072:12345-0@lo:400:kworker.0 Request processed in 27us (2555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584141.290732:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789584141.290742:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789584141.290747:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876514253858816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584141.290775:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876514253858816:12345-0@lo:400:kworker.0 Request processed in 29us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584141.290781:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789584141.290798:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789584141.290801:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789584141.290827:0:3456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8df6f8d180 x1876514253858816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584141.290842:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3456:1876514253858816:0@lo:400:kworker.0 00000100:00100000:2.0:1789584141.290870:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876514253858560:0@lo:400:kworker.0 00010000:00080000:2.0:1789584141.290882:0:3455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8df6f8e300 x1876514253859072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789584141.290891:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3455:1876514253859072:0@lo:400:kworker.0 00000100:00100000:2.0:1789584141.290902:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dff9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876514253858176:0@lo:400:kworker.0 00000100:00100000:2.0:1789584141.290911:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3455:1876514253858688:0@lo:400:kworker.0 00000100:00100000:2.0:1789584141.290928:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253857664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789584141.291276:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df7819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253858432:0@lo:400:kworker.0 00000100:00100000:0.0:1789584141.291288:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3457:1876514253858944:0@lo:400:kworker.0 00000100:00100000:0.0:1789584141.291414:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253857792 00000100:00100000:0.0:1789584141.291418:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253857792 00000100:00100000:0.0:1789584141.292138:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789584141.292150:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:3456:x1876514253857792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584141.292285:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:3456:x1876514253857792:12345-0@lo:400:kworker.0 Request processed in 139us (6147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584141.292292:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789584141.292596:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3456:1876514253857792:0@lo:400:kworker.0 00000100:00100000:1.0:1789584141.295131:0:23255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253857920:12345-0@lo:400:kworker.0 Request processed in 9685us (9980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584141.295146:0:23255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789584141.295216:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dc4c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253857920:0@lo:400:kworker.0 00000040:00080000:0.0:1789584141.534888:0:22601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789584141.985401:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789584142.325566:0:24693:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccd2a45d0 20000000:00000080:3.0:1789584142.325587:0:24693:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f8cc6887400 uarg=0000000000000000 20000000:01000000:3.0:1789584142.325626:0:24693:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789584142.325632:0:24693:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789584142.325637:0:24693:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789584142.326669:0:24694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1789584142.326945:0:24693:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789584142.335557:0:24693:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789584142.335705:0:24693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8dc4c61800/0x113b6add9f8697d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.335736:0:24693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8cc48c0c00/0x113b6add9f86942d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869426 expref: 23 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.335744:0:24693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86943b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869434 expref: 23 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.335752:0:24693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8e02047400/0x113b6add9f86947a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869473 expref: 23 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.335759:0:24693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8dc0031200/0x113b6add9f8695f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f8695ed expref: 23 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.335776:0:24693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8ded95d400/0x113b6add9f869760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee1e3 expref: 12 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.335785:0:24693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8e02047000/0x113b6add9f86979f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee253 expref: 12 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.335793:0:24693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8dc4c61800/0x113b6add9f8697d0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.335842:0:24693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8e02047000/0x113b6add9f86979f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee253 expref: 12 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.335861:0:24693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8e02047000/0x113b6add9f86979f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee253 expref: 12 pid: 21937 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584142.335897:0:24693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24693:1876514253859328:192.168.204.11@tcp:104: 00010000:00010000:2.0:1789584142.336152:0:24693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8ded95d400/0x113b6add9f869760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee1e3 expref: 12 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.336162:0:24693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8ded95d400/0x113b6add9f869760 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee1e3 expref: 12 pid: 21938 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584142.336171:0:24693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24693:1876514253859456:192.168.204.11@tcp:104: 00010000:00010000:2.0:1789584142.336234:0:24693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8dc0031200/0x113b6add9f8695f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x113b6add9f8695ed expref: 23 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.336243:0:24693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8dc0031200/0x113b6add9f8695f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x113b6add9f8695ed expref: 23 pid: 21938 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584142.336629:0:24693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24693:1876514253859584:0@lo:104: 00000100:00100000:2.0:1789584142.336676:0:24693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789584142.336726:0:24693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8e02047400/0x113b6add9f86947a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x113b6add9f869473 expref: 23 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.336735:0:24693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8e02047400/0x113b6add9f86947a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x113b6add9f869473 expref: 23 pid: 21938 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584142.336742:0:24693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24693:1876514253859712:0@lo:104: 00000100:00100000:1.0:1789584142.336984:0:21928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253859584 00000100:00100000:1.0:1789584142.337001:0:21928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253859584 00000100:00100000:1.0:1789584142.337088:0:21928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789584142.337099:0:24693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584142.337104:0:21928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+3:24693:x1876514253859584:12345-0@lo:104: 00010000:00010000:1.0:1789584142.337127:0:21928:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8695ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8695f4 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.337136:0:24693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86943b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x113b6add9f869434 expref: 23 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.337150:0:24693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86943b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x113b6add9f869434 expref: 23 pid: 21937 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584142.337172:0:24693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24693:1876514253859840:0@lo:104: 00000100:00100000:3.0:1789584142.337291:0:21929:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789584142.337300:0:21929:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1789584142.337898:0:24693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789584142.337932:0:24693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8cc48c0c00/0x113b6add9f86942d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x113b6add9f869426 expref: 23 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.337942:0:24693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8cc48c0c00/0x113b6add9f86942d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x113b6add9f869426 expref: 23 pid: 21939 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584142.337951:0:24693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24693:1876514253859968:0@lo:104: 00000100:00100000:2.0:1789584142.337973:0:24693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584142.338329:0:24693:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc83680c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584142.338843:0:21929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253859712 00000100:00100000:3.0:1789584142.338851:0:21929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253859712 00000100:00100000:3.0:1789584142.338891:0:21929:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789584142.338898:0:21929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253859840 00000100:00100000:3.0:1789584142.338901:0:21929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253859840 00000100:00100000:3.0:1789584142.338910:0:21929:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789584142.338914:0:21929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253859968 00000100:00100000:3.0:1789584142.338917:0:21929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253859968 00000100:00100000:0.0:1789584142.339154:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789584142.339165:0:24695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+6:24693:x1876514253859712:12345-0@lo:104: 00010000:00010000:0.0:1789584142.339184:0:24695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9c00/0x113b6add9f869473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f86947a expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584142.340460:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789584142.340471:0:24695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+6:24693:x1876514253859712:12345-0@lo:104: Request processed in 1305us (3700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584142.340482:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789584142.340507:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789584142.340515:0:24695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+5:24693:x1876514253859840:12345-0@lo:104: 00010000:00010000:0.0:1789584142.340527:0:24695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0800/0x113b6add9f869434 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f86943b expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584142.341682:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00010000:00010000:1.0:1789584142.341964:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789584142.341982:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9c00/0x113b6add9f869473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f86947a expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.342023:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe9c00 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:1.0:1789584142.342029:0:21934:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9c00/0x113b6add9f869473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x113b6add9f86947a expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584142.342064:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584142.342119:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228565120 00000100:00100000:2.0:1789584142.342129:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228565120 00010000:00010000:2.0:1789584142.342166:0:21931:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8ded95d400/0x113b6add9f869760 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee1e3 expref: 13 pid: 21938 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.342183:0:21934:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9c00/0x113b6add9f869473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x113b6add9f86947a expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789584142.342219:0:21934:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9c00/0x113b6add9f869473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x113b6add9f86947a expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584142.342226:0:21934:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789584142.342296:0:21934:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9c00/0x113b6add9f869473 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f86947a expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.342305:0:21934:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789584142.342343:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9c00/0x113b6add9f869473 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f86947a expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.342351:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9c00/0x113b6add9f869473 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f86947a expref: -99 pid: 23254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584142.342360:0:24693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24693:1876514253859328:192.168.204.11@tcp:104: 00010000:00010000:1.0:1789584142.342373:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584142.342376:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584142.342378:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789584142.342410:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789584142.342568:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3457:1876514253860096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789584142.342572:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228564992 00000100:00100000:2.0:1789584142.342582:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228564992 00010000:00010000:2.0:1789584142.342603:0:21931:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8e02047000/0x113b6add9f86979f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee253 expref: 14 pid: 21937 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584142.342628:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:2.0:1789584142.342637:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98df0fde-e9b8-4032-b372-dfd508e8b711+14:2400:x1876514228565120:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789584142.342652:0:21931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789584142.342658:0:21931:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8ded95d400/0x113b6add9f869760 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee1e3 expref: 14 pid: 21938 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.342682:0:21931:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8ded95d400/0x113b6add9f869760 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee1e3 expref: 14 pid: 21938 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.342704:0:21931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789584142.342818:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98df0fde-e9b8-4032-b372-dfd508e8b711+14:2400:x1876514228565120:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 182us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584142.342826:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:2.0:1789584142.342846:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:2.0:1789584142.342854:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98df0fde-e9b8-4032-b372-dfd508e8b711+13:2400:x1876514228564992:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789584142.342862:0:21931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789584142.342866:0:21931:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8e02047000/0x113b6add9f86979f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee253 expref: 13 pid: 21937 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.342876:0:21931:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8e02047000/0x113b6add9f86979f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee253 expref: 13 pid: 21937 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.342886:0:21931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8e02047000/0x113b6add9f86979f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee253 expref: 13 pid: 21937 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.342897:0:21931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789584142.342916:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98df0fde-e9b8-4032-b372-dfd508e8b711+12:2400:x1876514228564992:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 63us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584142.342923:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:1.0:1789584142.342954:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789584142.342993:0:24693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8ded95d400/0x113b6add9f869760 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee1e3 expref: 11 pid: 21938 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584142.343006:0:24693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24693:1876514253859456:192.168.204.11@tcp:104: 00000100:00100000:3.0:1789584142.343017:0:24693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24693:1876514253859584:0@lo:104: 00000100:00100000:3.0:1789584142.343039:0:24693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24693:1876514253859712:0@lo:104: 00000100:00100000:2.0:1789584142.343091:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253860096 00000100:00100000:2.0:1789584142.343098:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253860096 00010000:00010000:2.0:1789584142.343118:0:21930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8e02047400/0x113b6add9f86947a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f869473 expref: 24 pid: 21938 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.343124:0:21928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789584142.343139:0:21928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+5:24693:x1876514253859584:12345-0@lo:104: Request processed in 6036us (6457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584142.343169:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789584142.343170:0:21928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789584142.343234:0:24198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789584142.343241:0:24198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8695ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f8695f4 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584142.343351:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:3457:x1876514253860096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789584142.343361:0:21930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789584142.343366:0:21930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8e02047400/0x113b6add9f86947a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f869473 expref: 24 pid: 21938 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.343375:0:21930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8e02047400/0x113b6add9f86947a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x113b6add9f869473 expref: 24 pid: 21938 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.343386:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8e02047400/0x113b6add9f86947a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x113b6add9f869473 expref: 24 pid: 21938 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.343395:0:21930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789584142.343535:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:3457:x1876514253860096:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584142.343543:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789584142.343668:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3457:1876514253860096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789584142.343736:0:24198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc0031e00 already unused, calling callback (ffffffffc1befc20) 10000000:00010000:1.0:1789584142.343741:0:24198:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8695ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x113b6add9f8695f4 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.343750:0:24198:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8695ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x113b6add9f8695f4 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789584142.343756:0:24198:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8695ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x113b6add9f8695f4 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789584142.343762:0:24198:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789584142.343819:0:24198:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8695ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8695f4 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.343826:0:24198:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789584142.343850:0:24198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8695ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8695f4 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.343857:0:24198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031e00/0x113b6add9f8695ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f8695f4 expref: -99 pid: 23978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.343871:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584142.343873:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584142.343875:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789584142.343885:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789584142.343992:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3456:1876514253860224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789584142.344364:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584142.344423:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253860224 00000100:00100000:2.0:1789584142.344431:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253860224 00010000:00010000:2.0:1789584142.344457:0:21932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8dc0031200/0x113b6add9f8695f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8695ed expref: 23 pid: 21938 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584142.344484:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789584142.344491:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:3456:x1876514253860224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789584142.344503:0:21932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789584142.344508:0:21932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8dc0031200/0x113b6add9f8695f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f8695ed expref: 23 pid: 21938 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.344549:0:21932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8dc0031200/0x113b6add9f8695f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x113b6add9f8695ed expref: 23 pid: 21938 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.344564:0:21932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8dc0031200/0x113b6add9f8695f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x113b6add9f8695ed expref: 23 pid: 21938 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.344577:0:21932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789584142.344672:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789584142.344688:0:24695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+4:24693:x1876514253859840:12345-0@lo:104: Request processed in 4171us (6788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584142.344698:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789584142.344709:0:21928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789584142.344728:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789584142.344729:0:21928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+3:24693:x1876514253859968:12345-0@lo:104: 00000100:00100000:3.0:1789584142.344741:0:24693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24693:1876514253859840:0@lo:104: 00010000:00010000:0.0:1789584142.344741:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0800/0x113b6add9f869434 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f86943b expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584142.344753:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8cc48c0800 already unused, calling callback (ffffffffc1befc20) 00010000:00010000:1.0:1789584142.344755:0:21928:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f869426 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f86942d expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789584142.344759:0:21933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0800/0x113b6add9f869434 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x113b6add9f86943b expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584142.344842:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:3456:x1876514253860224:12345-0@lo:103:ldlm_bl.0 Request processed in 348us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584142.344850:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789584142.344906:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3456:1876514253860224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789584142.344956:0:21928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789584142.344965:0:21928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+3:24693:x1876514253859968:12345-0@lo:104: Request processed in 245us (6989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584142.344974:0:21928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789584142.344985:0:24693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24693:1876514253859968:0@lo:104: 00010000:00010000:1.0:1789584142.345017:0:21934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789584142.345025:0:21934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f869426 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x113b6add9f86942d expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584142.345027:0:24693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8dc4c61800/0x113b6add9f8697d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584142.345136:0:21933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0800/0x113b6add9f869434 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x113b6add9f86943b expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789584142.345143:0:21933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0800/0x113b6add9f869434 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x113b6add9f86943b expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789584142.345148:0:21933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789584142.345367:0:21933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0800/0x113b6add9f869434 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f86943b expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584142.345375:0:21933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789584142.345419:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0800/0x113b6add9f869434 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f86943b expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.345428:0:21934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc0031a00 already unused, calling callback (ffffffffc1befc20) 00010000:00010000:0.0:1789584142.345431:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8cc48c0800/0x113b6add9f869434 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f86943b expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789584142.345439:0:21934:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f869426 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x113b6add9f86942d expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584142.345451:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584142.345455:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584142.345457:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584142.345480:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253860352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789584142.345538:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789584142.345581:0:21934:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f869426 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x113b6add9f86942d expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584142.345589:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253860352 10000000:00010000:1.0:1789584142.345591:0:21934:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f869426 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x113b6add9f86942d expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584142.345600:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253860352 00010000:00010000:0.0:1789584142.345621:0:21930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86943b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f869434 expref: 22 pid: 21937 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584142.345645:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789584142.345652:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dd86bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:3454:x1876514253860352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789584142.345664:0:21930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789584142.345669:0:21930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86943b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f869434 expref: 22 pid: 21937 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584142.345680:0:21930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86943b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x113b6add9f869434 expref: 22 pid: 21937 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584142.345691:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8cc48c1e00/0x113b6add9f86943b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x113b6add9f869434 expref: 22 pid: 21937 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584142.345702:0:21930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789584142.345729:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dd86bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:3454:x1876514253860352:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584142.345735:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789584142.345783:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253860352:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1789584142.345843:0:21934:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789584142.345995:0:21934:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f869426 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f86942d expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.346003:0:21934:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789584142.346072:0:21934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f869426 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f86942d expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.346080:0:21934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff8f8dc0031a00/0x113b6add9f869426 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x113b6add9f86942d expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.346103:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584142.346105:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789584142.346108:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789584142.346275:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789584142.346294:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253860480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789584142.346356:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584142.346618:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253860480 00000100:00100000:1.0:1789584142.346626:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253860480 00010000:00010000:1.0:1789584142.346661:0:21932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8cc48c0c00/0x113b6add9f86942d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f869426 expref: 21 pid: 21939 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584142.346699:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789584142.346708:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:3454:x1876514253860480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789584142.346722:0:21932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789584142.346728:0:21932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8cc48c0c00/0x113b6add9f86942d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x113b6add9f869426 expref: 21 pid: 21939 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.346742:0:21932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8cc48c0c00/0x113b6add9f86942d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x113b6add9f869426 expref: 21 pid: 21939 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.346758:0:21932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8cc48c0c00/0x113b6add9f86942d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x113b6add9f869426 expref: 21 pid: 21939 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.346779:0:21932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8dc4c61800/0x113b6add9f8697d0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.346790:0:21932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8dc4c61800/0x113b6add9f8697d0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.346826:0:21932:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8dc4c61800/0x113b6add9f8697d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.346835:0:21932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8dc4c61800/0x113b6add9f8697d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.346842:0:21932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8dc4c61800/0x113b6add9f8697d0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.346850:0:21932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8dc4c61800/0x113b6add9f8697d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.346858:0:21932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c61800 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:1.0:1789584142.346863:0:21932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8dc4c61800/0x113b6add9f8697d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.346871:0:21932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8dc4c61800/0x113b6add9f8697d0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.346893:0:21932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8dc4c61800/0x113b6add9f8697d0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584142.346905:0:21932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789584142.346952:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:3454:x1876514253860480:12345-0@lo:103:ldlm_bl.0 Request processed in 245us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584142.346960:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789584142.347419:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253860480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789584142.347896:0:24693:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8dc4c61800/0x113b6add9f8697d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584142.347915:0:24693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8dc4c61800/0x113b6add9f8697d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584142.347923:0:24693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8dc4c61800/0x113b6add9f8697d0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584143.003544:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584143.449110:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584143.449734:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228565248 00000100:00100000:1.0:1789584143.449776:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228565248 00000100:00100000:1.0:1789584143.449925:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 146 00000100:00100000:1.0:1789584143.449940:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+11:18395:x1876514228565248:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789584143.449964:0:21937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584143.449996:0:21937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8ded95d400/0x113b6add9f8697d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee28b expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584143.450044:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8ded95d400/0x113b6add9f8697d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee28b expref: 12 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584143.450058:0:21937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8ded95d400/0x113b6add9f8697d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee28b expref: 12 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584143.450069:0:21937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8ded95d400, rc 0) 00000100:00100000:1.0:1789584143.450154:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+12:18395:x1876514228565248:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 Request processed in 217us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584143.450161:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 146 00000100:00100000:2.0:1789584143.462557:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584143.467414:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228565376 00000100:00100000:0.0:1789584143.467510:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228565376 00000100:00100000:0.0:1789584143.467753:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 147 00000100:00100000:0.0:1789584143.467768:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+12:18395:x1876514228565376:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789584143.469020:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+12:18395:x1876514228565376:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 Request processed in 1243us (6466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584143.469043:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 147 00000100:00100000:2.0:1789584143.476729:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584143.477339:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228565504 00000100:00100000:1.0:1789584143.477355:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228565504 00000100:00100000:1.0:1789584143.477504:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 148 00000100:00100000:1.0:1789584143.477518:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+12:18395:x1876514228565504:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789584143.479777:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+12:18395:x1876514228565504:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 Request processed in 2242us (3043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584143.479797:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 148 00000100:00100000:3.0:1789584143.494537:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584143.495292:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228565632 00000100:00100000:0.0:1789584143.495308:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228565632 00000100:00100000:0.0:1789584143.495439:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 149 00000100:00100000:0.0:1789584143.495453:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+12:18395:x1876514228565632:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789584143.495476:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789584143.495900:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8defc5e800/0x113b6add9f8697de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee292 expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584143.495946:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8defc5e800/0x113b6add9f8697de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee292 expref: 13 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584143.495961:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8defc5e800/0x113b6add9f8697de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee292 expref: 13 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584143.495972:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8defc5e800, rc 0) 00000100:00100000:0.0:1789584143.496068:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+13:18395:x1876514228565632:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 Request processed in 618us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584143.496076:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 149 00000100:00100000:1.0:1789584143.500461:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584143.501165:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228565760 00000100:00100000:2.0:1789584143.501182:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228565760 00000100:00100000:2.0:1789584143.501333:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 150 00000100:00100000:2.0:1789584143.501347:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+13:18395:x1876514228565760:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789584143.501752:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98df0fde-e9b8-4032-b372-dfd508e8b711+13:18395:x1876514228565760:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 Request processed in 407us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584143.501771:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 150 00000100:00100000:1.0:1789584143.509341:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584143.509744:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228565888 00000100:00100000:0.0:1789584143.509762:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228565888 00000100:00100000:0.0:1789584143.509843:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 151 00000100:00100000:0.0:1789584143.509856:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+13:18395:x1876514228565888:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789584143.510229:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+13:18395:x1876514228565888:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 Request processed in 372us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584143.510248:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 151 00010000:00010000:0.0:1789584144.028784:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789584144.095057:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584144.095181:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228566016 00000100:00100000:2.0:1789584144.095246:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228566016 00000100:00100000:2.0:1789584144.095346:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:2.0:1789584144.095361:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+6:19015:x1876514228566016:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789584144.095391:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584144.095434:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f8697e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee299 expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.095991:0:21947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8697ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.096014:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8697ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.096037:0:21947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8697ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.096057:0:21947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f8697f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.096065:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f8697f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.096072:0:21947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f8697f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789584144.096313:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789584144.101298:0:21947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60800/0x113b6add9f8697fa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.101351:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60800/0x113b6add9f8697fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.101369:0:21947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60800/0x113b6add9f8697fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789584144.101419:0:21947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789584144.101423:0:21947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789584144.101474:0:21947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60800/0x113b6add9f8697fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.105807:0:21947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8697ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.105821:0:21947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8697ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.105829:0:21947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8697ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.105836:0:21947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c60400 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:2.0:1789584144.105842:0:21947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8697ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.105851:0:21947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8697ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.105872:0:21947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8de236f000) 00010000:00010000:2.0:1789584144.105875:0:21947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789584144.105882:0:21947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8697ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.105921:0:21947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8697ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.105943:0:21947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f8697f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.105950:0:21947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f8697f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.105956:0:21947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f8697f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.105961:0:21947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c61400 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:2.0:1789584144.105964:0:21947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f8697f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.105970:0:21947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f8697f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.105979:0:21947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f8de236fd00) 00010000:00010000:2.0:1789584144.105982:0:21947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789584144.105985:0:21947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f8697f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.105992:0:21947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f8697f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.106076:0:21947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f8697e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee299 expref: 8 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.106108:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60800/0x113b6add9f8697fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee299 expref: 7 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.106116:0:21947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f8de236f800) 00010000:00010000:2.0:1789584144.106118:0:21947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789584144.106121:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8dc4c60800, rc 0) 00000100:00100000:2.0:1789584144.106924:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+7:19015:x1876514228566016:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 11559us (11875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584144.106937:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:3.0:1789584144.112275:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584144.112451:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228566144 00000100:00100000:1.0:1789584144.112466:0:21956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228566144 00000100:00100000:1.0:1789584144.112543:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:1.0:1789584144.112555:0:21956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:319b0417-2da6-48eb-878f-de6e4d622177+7:19015:x1876514228566144:12345-192.168.204.11@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789584144.112702:0:21956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:319b0417-2da6-48eb-878f-de6e4d622177+7:19015:x1876514228566144:12345-192.168.204.11@tcp:900:lhsmtool_posix.0 Request processed in 149us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584144.112711:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:3.0:1789584144.132937:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584144.133252:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228566400 00000100:00100000:0.0:1789584144.133268:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228566400 00000100:00100000:0.0:1789584144.133346:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:0.0:1789584144.133359:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+7:19015:x1876514228566400:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789584144.133586:0:21946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789584144.133692:0:21946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f869801 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee2a0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.133804:0:21946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e200/0x113b6add9f869808 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.133823:0:21946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e200/0x113b6add9f869808 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.134077:0:21946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e200/0x113b6add9f869808 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.134097:0:21946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f86980f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.134106:0:21946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f86980f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.134112:0:21946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f86980f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.136951:0:21946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f600/0x113b6add9f869816 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.136982:0:21946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f600/0x113b6add9f869816 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.136997:0:21946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f600/0x113b6add9f869816 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789584144.137017:0:21946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789584144.142399:0:21946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e200/0x113b6add9f869808 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.142423:0:21946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e200/0x113b6add9f869808 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.142432:0:21946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e200/0x113b6add9f869808 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.142439:0:21946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5e200 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:0.0:1789584144.142444:0:21946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e200/0x113b6add9f869808 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.142453:0:21946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e200/0x113b6add9f869808 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.142475:0:21946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f8de236f800) 00010000:00010000:0.0:1789584144.142897:0:21946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789584144.142907:0:21946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e200/0x113b6add9f869808 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.142946:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e200/0x113b6add9f869808 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.142969:0:21946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f86980f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.142975:0:21946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f86980f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.142981:0:21946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f86980f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.142986:0:21946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5fc00 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:0.0:1789584144.142990:0:21946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f86980f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.142997:0:21946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f86980f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.143006:0:21946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f8dda0a5f00) 00010000:00010000:0.0:1789584144.143009:0:21946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789584144.143012:0:21946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f86980f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.143017:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f86980f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.145992:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f869801 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2a0 expref: 10 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.146056:0:21946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f600/0x113b6add9f869816 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2a0 expref: 9 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.146067:0:21946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8dda0a5600) 00010000:00010000:0.0:1789584144.146070:0:21946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789584144.146074:0:21946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8defc5f600, rc 0) 00000100:00100000:0.0:1789584144.146180:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+9:19015:x1876514228566400:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 12821us (13258us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789584144.146228:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:2.0:1789584144.157750:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584144.165061:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228566528 00000100:00100000:0.0:1789584144.165084:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228566528 00000100:00100000:0.0:1789584144.165209:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:0.0:1789584144.165223:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+9:19015:x1876514228566528:12345-192.168.204.11@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789584144.165384:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+9:19015:x1876514228566528:12345-192.168.204.11@tcp:59:lhsmtool_posix.0 Request processed in 164us (7648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584144.165392:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:3.0:1789584144.173330:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584144.173451:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228566656 00000100:00100000:0.0:1789584144.173473:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228566656 00000100:00100000:0.0:1789584144.173582:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:0.0:1789584144.173596:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+5:19015:x1876514228566656:12345-192.168.204.11@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1789584144.176296:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1789584144.180202:0:21946:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6520us 00000100:00100000:2.0:1789584144.197427:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584144.197801:0:21945:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789584144.197816:0:21945:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789584144.198269:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228566784 00000100:00100000:2.0:1789584144.198283:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228566784 00000100:00100000:3.0:1789584144.198612:0:24708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:3.0:1789584144.198805:0:24708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+9:19021:x1876514228566784:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1789584144.198845:0:24708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789584144.198879:0:24708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9800/0x113b6add9f869824 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee2a7 expref: -99 pid: 24708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.198967:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8800/0x113b6add9f86982b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.198998:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8800/0x113b6add9f86982b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199014:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8800/0x113b6add9f86982b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199045:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9200/0x113b6add9f869832 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199053:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9200/0x113b6add9f869832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199060:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9200/0x113b6add9f869832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199368:0:24708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8800/0x113b6add9f86982b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199378:0:24708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8800/0x113b6add9f86982b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199385:0:24708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8800/0x113b6add9f86982b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199391:0:24708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8800 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:3.0:1789584144.199397:0:24708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8800/0x113b6add9f86982b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199406:0:24708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8800/0x113b6add9f86982b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199421:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8de236f000) 00010000:00010000:3.0:1789584144.199431:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789584144.199438:0:24708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8800/0x113b6add9f86982b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199445:0:24708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8800/0x113b6add9f86982b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199762:0:24708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9200/0x113b6add9f869832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199771:0:24708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9200/0x113b6add9f869832 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199777:0:24708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9200/0x113b6add9f869832 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199783:0:24708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe9200 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:3.0:1789584144.199786:0:24708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9200/0x113b6add9f869832 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199793:0:24708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9200/0x113b6add9f869832 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199802:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8f8dc785d100) 00010000:00010000:3.0:1789584144.199805:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789584144.199809:0:24708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9200/0x113b6add9f869832 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199814:0:24708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9200/0x113b6add9f869832 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199919:0:24708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9800/0x113b6add9f869824 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2a7 expref: 10 pid: 24708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199940:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8de236f000) 00010000:00010000:3.0:1789584144.199942:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789584144.199945:0:24708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9800/0x113b6add9f869824 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2a7 expref: 10 pid: 24708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.199955:0:24708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8df4fe9800, rc 0) 00000100:00100000:3.0:1789584144.200132:0:24708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+9:19021:x1876514228566784:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 1508us (2720us total) trans 0 rc 301/301 00000100:00100000:3.0:1789584144.200143:0:24708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:3.0:1789584144.218965:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584144.219301:0:21954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228566912 00000100:00100000:2.0:1789584144.219315:0:21954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228566912 00000100:00100000:2.0:1789584144.219396:0:21954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:2.0:1789584144.219409:0:21954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dff9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:319b0417-2da6-48eb-878f-de6e4d622177+9:19021:x1876514228566912:12345-192.168.204.11@tcp:700:lfs.0 00000100:00100000:2.0:1789584144.219537:0:21954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:319b0417-2da6-48eb-878f-de6e4d622177+9:19021:x1876514228566912:12345-192.168.204.11@tcp:700:lfs.0 Request processed in 130us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584144.219546:0:21954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:0.0:1789584144.230380:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dff9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+5:19015:x1876514228566656:12345-192.168.204.11@tcp:59:lhsmtool_posix.0 Request processed in 56770us (57050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584144.230411:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:3.0:1789584144.239913:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584144.240047:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228567168 00000100:00100000:2.0:1789584144.240061:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228567168 00000100:00100000:2.0:1789584144.240143:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 28 00000100:00100000:2.0:1789584144.240157:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+9:19021:x1876514228567168:12345-192.168.204.11@tcp:36:lfs.0 00010000:00010000:2.0:1789584144.240299:0:21945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789584144.240337:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8e02046200/0x113b6add9f86978a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee214 expref: 9 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.240363:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8de236f000) 00010000:00010000:2.0:1789584144.240369:0:21945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789584144.240661:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f869839 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.240680:0:21945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f8697c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee284 expref: 5 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.240690:0:21945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f869839 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.240737:0:21945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f8697c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee284 expref: 5 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.240756:0:21945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f8697c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee284 expref: 5 pid: 21945 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584144.240775:0:21945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21945:1876514253860608:192.168.204.11@tcp:104: 00000100:00100000:2.0:1789584144.240907:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc2eefd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789584144.243676:0:21945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21945:1876514253860608:192.168.204.11@tcp:104: 00010000:00010000:3.0:1789584144.243722:0:21945:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f869839 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584144.247880:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584144.248126:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228567296 00000100:00100000:0.0:1789584144.248141:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228567296 00010000:00010000:0.0:1789584144.248262:0:21930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f8697c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee284 expref: 6 pid: 21945 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584144.248315:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00100000:0.0:1789584144.248326:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2408ec3-193f-4ced-b3de-620548852bdb+6:2399:x1876514228567296:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789584144.248345:0:21930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789584144.248354:0:21930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f8697c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee284 expref: 6 pid: 21945 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.248370:0:21930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f8697c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee284 expref: 6 pid: 21945 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.248409:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f8697c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee284 expref: 6 pid: 21945 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.248427:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8de236f000) 00010000:00010000:0.0:1789584144.248434:0:21930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f869839 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.248444:0:21930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f869839 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.248453:0:21930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f869839 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.248492:0:21930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789584144.248536:0:21945:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f869839 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.248557:0:21945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f869839 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584144.248564:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2408ec3-193f-4ced-b3de-620548852bdb+5:2399:x1876514228567296:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 237us (697us total) trans 0 rc 0/0 00010000:00010000:3.0:1789584144.248595:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8a00/0x113b6add9f869840 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584144.248595:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 15 00010000:00010000:3.0:1789584144.248612:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8a00/0x113b6add9f869840 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.248635:0:21945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8a00/0x113b6add9f869840 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789584144.248797:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789584144.250856:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61c00/0x113b6add9f869847 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.250884:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61c00/0x113b6add9f869847 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.250910:0:21945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61c00/0x113b6add9f869847 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789584144.250931:0:21945:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dedc994 reply state 00000000d390f318 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61c00/0x113b6add9f869847 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.250945:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61c00/0x113b6add9f869847 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.250953:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f8de236fd00) 00010000:00010000:2.0:1789584144.250956:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789584144.250962:0:21945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789584144.250970:0:21945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789584144.250979:0:21945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f869839 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.250986:0:21945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f869839 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.250993:0:21945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f869839 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.250999:0:21945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c61400 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:2.0:1789584144.251004:0:21945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f869839 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.251632:0:21945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f869839 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.251649:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8de236f000) 00010000:00010000:2.0:1789584144.251651:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789584144.251665:0:21945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f869839 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.251672:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61400/0x113b6add9f869839 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789584144.251695:0:21945:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dedc994 reply state 00000000d390f318 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8a00/0x113b6add9f869840 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.251707:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8a00/0x113b6add9f869840 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.251714:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8f8dc785d100) 00010000:00010000:2.0:1789584144.251716:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789584144.251718:0:21945:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789584144.251869:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+10:19021:x1876514228567168:12345-192.168.204.11@tcp:36:lfs.0 Request processed in 11710us (11966us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789584144.251880:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 28 10000000:01000000:1.0:1789584144.286418:0:21942:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789584144.286430:0:21942:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8ded947000 from 13 10000000:01000000:1.0:1789584144.286438:0:21942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789584144.286510:0:21942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8ded95de00/0x113b6add9f86984e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.286523:0:21942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8ded95de00/0x113b6add9f86984e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.286538:0:21942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8ded95de00/0x113b6add9f86984e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584144.286574:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253860736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789584144.286677:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584144.286744:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc1377000 going to sleep for 11 seconds 00000100:00100000:3.0:1789584144.286759:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253860736 00000100:00100000:3.0:1789584144.286773:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253860736 00000100:00100000:3.0:1789584144.286850:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789584144.286863:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+20:21942:x1876514253860736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789584144.286881:0:21939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789584144.286901:0:21939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8df4fe9800/0x113b6add9f869855 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f86984e expref: -99 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.286935:0:21939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8df4fe9800/0x113b6add9f869855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f86984e expref: 21 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.286949:0:21939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8df4fe9800/0x113b6add9f869855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f86984e expref: 21 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.286959:0:21939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8df4fe9800, rc 0) 00000100:00100000:3.0:1789584144.287158:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:21942:x1876514253860736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 298us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584144.287166:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789584144.287375:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253860736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789584144.287394:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8ded95de00/0x113b6add9f86984e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869855 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.287404:0:21942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8ded95de00/0x113b6add9f86984e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f869855 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584144.287472:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253860864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789584144.287512:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584144.287574:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc1377000 going to sleep for 11 seconds 00000100:00100000:2.0:1789584144.287611:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253860864 00000100:00100000:2.0:1789584144.287618:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253860864 00000100:00100000:2.0:1789584144.287658:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789584144.287667:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:21942:x1876514253860864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789584144.288029:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:21942:x1876514253860864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584144.288037:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789584144.288342:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253860864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789584144.288636:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253860992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789584144.288690:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584144.288729:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc1377000 going to sleep for 11 seconds 00000100:00100000:3.0:1789584144.288871:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253860992 00000100:00100000:3.0:1789584144.288878:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253860992 00000100:00100000:3.0:1789584144.288918:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789584144.288928:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:21942:x1876514253860992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789584144.289155:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:21942:x1876514253860992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584144.289172:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789584144.289395:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253860992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789584144.290435:0:24709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789584144.297924:0:21942:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789584144.297978:0:21942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789584144.298009:0:21942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8ded95de00/0x113b6add9f86984e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869855 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.298036:0:21942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8ded95de00/0x113b6add9f86984e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869855 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789584144.298052:0:21942:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789584144.298057:0:21942:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8dd12e9800 from 13 10000000:01000000:3.0:1789584144.298060:0:21942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789584144.298122:0:21942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86985c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.298132:0:21942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86985c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.298146:0:21942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86985c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584144.298182:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfc88ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253861120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789584144.298314:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584144.298388:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df74c90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789584144.298505:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253861120 00000100:00100000:0.0:1789584144.298517:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253861120 00000100:00100000:0.0:1789584144.298586:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789584144.298598:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+21:21942:x1876514253861120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789584144.298879:0:21938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789584144.298901:0:21938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8defc5e200/0x113b6add9f869863 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f86985c expref: -99 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.298936:0:21938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8defc5e200/0x113b6add9f869863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f86985c expref: 22 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.298949:0:21938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8defc5e200/0x113b6add9f869863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f86985c expref: 22 pid: 21938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.298958:0:21938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8defc5e200, rc 0) 00000100:00100000:0.0:1789584144.299664:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:21942:x1876514253861120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1062us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584144.299676:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789584144.307832:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfc88ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253861120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789584144.307878:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86985c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869863 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.307894:0:21942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86985c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f869863 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584144.308526:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253861248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789584144.308632:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584144.308692:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd12bf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789584144.308764:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253861248 00000100:00100000:1.0:1789584144.308773:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253861248 00000100:00100000:1.0:1789584144.308842:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789584144.308854:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:21942:x1876514253861248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789584144.309341:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:21942:x1876514253861248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 486us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584144.309350:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789584144.309700:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253861248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789584144.309767:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253861376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789584144.309820:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584144.309854:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd12bf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789584144.318123:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253861376 00000100:00100000:0.0:1789584144.318147:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253861376 00000100:00100000:0.0:1789584144.318299:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789584144.318314:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:21942:x1876514253861376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789584144.318687:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:21942:x1876514253861376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 375us (8864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584144.318696:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789584144.319321:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253861376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789584144.321353:0:24710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789584144.321707:0:21942:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789584144.321740:0:21942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789584144.321756:0:21942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86985c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869863 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.321798:0:21942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe9200/0x113b6add9f86985c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869863 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789584144.321812:0:21942:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789584144.321815:0:21942:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8def4be000 from 13 10000000:01000000:3.0:1789584144.321818:0:21942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789584144.321871:0:21942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f86986a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.321880:0:21942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f86986a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.321894:0:21942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f86986a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584144.321929:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfc88f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253861504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789584144.322254:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584144.322313:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df74c9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789584144.322639:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253861504 00000100:00100000:2.0:1789584144.322651:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253861504 00000100:00100000:2.0:1789584144.322713:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789584144.322725:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc7368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+22:21942:x1876514253861504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789584144.322745:0:21937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584144.322768:0:21937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8dc4c61400/0x113b6add9f869871 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f86986a expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.322803:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8dc4c61400/0x113b6add9f869871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f86986a expref: 23 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.322816:0:21937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8dc4c61400/0x113b6add9f869871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f86986a expref: 23 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.322826:0:21937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8dc4c61400, rc 0) 00000100:00100000:2.0:1789584144.322893:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc7368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:21942:x1876514253861504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584144.322900:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789584144.322962:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfc88f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253861504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789584144.322979:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f86986a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869871 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.323722:0:21942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f86986a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f869871 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584144.323829:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253861632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789584144.323885:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584144.323918:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd12bf600 going to sleep for 11 seconds 00000100:00100000:0.0:1789584144.325591:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253861632 00000100:00100000:0.0:1789584144.325636:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253861632 00000100:00100000:0.0:1789584144.325714:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789584144.325726:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:21942:x1876514253861632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789584144.326224:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:21942:x1876514253861632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 463us (2301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584144.326234:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789584144.328287:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253861632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789584144.328402:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfc88c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253861760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789584144.328520:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584144.328586:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df74c9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789584144.328905:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253861760 00000100:00100000:2.0:1789584144.328916:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253861760 00000100:00100000:2.0:1789584144.328995:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789584144.329027:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dda102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:21942:x1876514253861760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789584144.329335:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dda102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:21942:x1876514253861760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 318us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584144.329344:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789584144.329844:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfc88c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253861760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789584144.332724:0:24711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789584144.332900:0:21942:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789584144.332940:0:21942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789584144.332958:0:21942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f86986a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869871 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.332974:0:21942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8df4fe8800/0x113b6add9f86986a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f869871 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789584144.332989:0:21942:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789584144.332992:0:21942:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8dff997800 from 13 10000000:01000000:2.0:1789584144.333012:0:21942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789584144.333076:0:21942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61600/0x113b6add9f869878 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.333086:0:21942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61600/0x113b6add9f869878 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.333122:0:21942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61600/0x113b6add9f869878 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584144.333158:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253861888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789584144.333271:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584144.333336:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc3eb0840 going to sleep for 11 seconds 00000100:00100000:1.0:1789584144.333375:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253861888 00000100:00100000:1.0:1789584144.333386:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253861888 00000100:00100000:1.0:1789584144.333460:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789584144.333472:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+23:21942:x1876514253861888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789584144.333488:0:21939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584144.333515:0:21939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8ded95c400/0x113b6add9f86987f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x113b6add9f869878 expref: -99 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.333546:0:21939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8ded95c400/0x113b6add9f86987f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x113b6add9f869878 expref: 24 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.333560:0:21939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8ded95c400/0x113b6add9f86987f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x113b6add9f869878 expref: 24 pid: 21939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.333570:0:21939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8ded95c400, rc 0) 00000100:00100000:1.0:1789584144.333640:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:21942:x1876514253861888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584144.333647:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789584144.337340:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253861888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789584144.337397:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61600/0x113b6add9f869878 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86987f expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.337438:0:21942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61600/0x113b6add9f869878 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x113b6add9f86987f expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584144.337599:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfc88c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253862016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789584144.337685:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584144.337754:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df74c9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789584144.340326:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253862016 00000100:00100000:1.0:1789584144.340349:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253862016 00000100:00100000:1.0:1789584144.340445:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789584144.340462:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:21942:x1876514253862016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789584144.340968:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:21942:x1876514253862016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 506us (3279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584144.340977:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789584144.344976:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfc88c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253862016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789584144.345091:0:21942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfc88c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253862144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789584144.345230:0:21942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584144.345291:0:21942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df74c9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789584144.345582:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253862144 00000100:00100000:1.0:1789584144.345593:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253862144 00000100:00100000:1.0:1789584144.345678:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789584144.345690:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:21942:x1876514253862144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789584144.345984:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:21942:x1876514253862144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 296us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584144.345993:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789584144.346168:0:21942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfc88c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:21942:1876514253862144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789584144.348580:0:24712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789584144.349361:0:21942:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789584144.349469:0:21942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789584144.349553:0:21942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61600/0x113b6add9f869878 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86987f expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.349569:0:21942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff8f8dc4c61600/0x113b6add9f869878 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x113b6add9f86987f expref: -99 pid: 21942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789584144.412897:0:21981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789584144.420932:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584144.421270:0:24708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228567424 00000100:00100000:0.0:1789584144.421284:0:24708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228567424 00000100:00100000:0.0:1789584144.421363:0:24708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 29 00000100:00100000:0.0:1789584144.421377:0:24708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+10:19029:x1876514228567424:12345-192.168.204.11@tcp:101:lctl.0 00010000:00010000:0.0:1789584144.421415:0:24708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789584144.421448:0:24708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f869886 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee2ae expref: -99 pid: 24708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.421540:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fe00/0x113b6add9f86988d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.421858:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fe00/0x113b6add9f86988d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.421874:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fe00/0x113b6add9f86988d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789584144.421927:0:24708:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789584144.421931:0:24708:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789584144.421984:0:24708:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fe00/0x113b6add9f86988d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.422392:0:24708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f869886 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2ae expref: 12 pid: 24708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.422445:0:24708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fe00/0x113b6add9f86988d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2ae expref: 11 pid: 24708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.422456:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8dda0a5f00) 00010000:00010000:0.0:1789584144.422459:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789584144.422464:0:24708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8defc5fe00, rc 0) 00000100:00100000:0.0:1789584144.422847:0:24708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+11:19029:x1876514228567424:12345-192.168.204.11@tcp:101:lctl.0 Request processed in 1470us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584144.422859:0:24708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 29 00000100:00100000:1.0:1789584144.450733:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584144.450936:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228567552 00000100:00100000:0.0:1789584144.450952:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228567552 00000100:00100000:1.0:1789584144.451348:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:1.0:1789584144.451372:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2408ec3-193f-4ced-b3de-620548852bdb+5:19030:x1876514228567552:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1789584144.451401:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584144.451434:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f869894 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee2b5 expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.451531:0:21947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c600/0x113b6add9f86989b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.451554:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c600/0x113b6add9f86989b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.451571:0:21947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c600/0x113b6add9f86989b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789584144.451618:0:21947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789584144.451633:0:21947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789584144.451658:0:21947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c600/0x113b6add9f86989b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.451688:0:21947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f869894 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2b5 expref: 7 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.451711:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c600/0x113b6add9f86989b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2b5 expref: 6 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.451721:0:21947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8dda0a5f00) 00010000:00010000:1.0:1789584144.451725:0:21947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789584144.451729:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8ded95c600, rc 0) 00000100:00100000:1.0:1789584144.451818:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2408ec3-193f-4ced-b3de-620548852bdb+6:19030:x1876514228567552:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 459us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584144.451837:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:2.0:1789584144.458023:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584144.460901:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228567680 00000100:00100000:1.0:1789584144.460927:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228567680 00000100:00100000:1.0:1789584144.461042:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 31 00000100:00100000:1.0:1789584144.461054:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2408ec3-193f-4ced-b3de-620548852bdb+6:19030:x1876514228567680:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1789584144.461083:0:21946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584144.461112:0:21946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f8698a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee2bc expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461233:0:21946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f8698a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461252:0:21946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f8698a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461268:0:21946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f8698a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461282:0:21946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461291:0:21946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461297:0:21946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461440:0:21946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8698b7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461624:0:21946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8698b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461633:0:21946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8698b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789584144.461681:0:21946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789584144.461685:0:21946:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789584144.461712:0:21946:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8698b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461728:0:21946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f8698a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461735:0:21946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f8698a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461742:0:21946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f8698a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461748:0:21946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95d800 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:1.0:1789584144.461753:0:21946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f8698a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461761:0:21946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f8698a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461777:0:21946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8dda0a5f00) 00010000:00010000:1.0:1789584144.461782:0:21946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789584144.461790:0:21946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f8698a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461809:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f8698a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461827:0:21946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461833:0:21946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461838:0:21946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461843:0:21946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95d600 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:1.0:1789584144.461846:0:21946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461852:0:21946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461859:0:21946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8f8dc785d100) 00010000:00010000:1.0:1789584144.461862:0:21946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789584144.461865:0:21946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461871:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461904:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f8698a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2bc expref: 8 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461931:0:21946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8698b7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2bc expref: 7 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.461939:0:21946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f8de236fd00) 00010000:00010000:1.0:1789584144.461942:0:21946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789584144.461945:0:21946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8ded95c200, rc 0) 00000100:00100000:1.0:1789584144.462063:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2408ec3-193f-4ced-b3de-620548852bdb+7:19030:x1876514228567680:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 1010us (4076us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584144.462071:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 31 00000100:00100000:3.0:1789584144.465071:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584144.466280:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228567808 00000100:00100000:1.0:1789584144.466297:0:21956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228567808 00000100:00100000:1.0:1789584144.466420:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:1.0:1789584144.466434:0:21956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e2408ec3-193f-4ced-b3de-620548852bdb+5:19030:x1876514228567808:12345-192.168.204.11@tcp:900:lfs.0 00000100:00100000:1.0:1789584144.466691:0:21956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e2408ec3-193f-4ced-b3de-620548852bdb+5:19030:x1876514228567808:12345-192.168.204.11@tcp:900:lfs.0 Request processed in 259us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584144.466700:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00080000:2.0:1789584144.470615:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789584144.478444:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584144.478610:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228568064 00000100:00100000:0.0:1789584144.478625:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228568064 00000100:00100000:0.0:1789584144.478702:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 32 00000100:00100000:0.0:1789584144.478715:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2408ec3-193f-4ced-b3de-620548852bdb+7:19030:x1876514228568064:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:0.0:1789584144.478742:0:21945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789584144.478771:0:21945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8698be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee2c3 expref: -99 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789584144.478909:0:21945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789584144.479109:0:21945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8698be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2c3 expref: 9 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.479127:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8dda0a5f00) 00010000:00010000:0.0:1789584144.479130:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789584144.479136:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8698be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2c3 expref: 9 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.479177:0:21945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8defc5f400, rc 0) 00000100:00100000:0.0:1789584144.479312:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2408ec3-193f-4ced-b3de-620548852bdb+8:19030:x1876514228568064:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 600us (885us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1789584144.479320:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 32 00000100:00100000:3.0:1789584144.484451:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584144.484617:0:24708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228568320 00000100:00100000:0.0:1789584144.484631:0:24708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228568320 00000100:00100000:0.0:1789584144.484705:0:24708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00100000:0.0:1789584144.484718:0:24708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2408ec3-193f-4ced-b3de-620548852bdb+8:19030:x1876514228568320:12345-192.168.204.11@tcp:36:lfs.0 00010000:00010000:0.0:1789584144.484795:0:24708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789584144.484834:0:24708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8698b7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2bc expref: 8 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.484860:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f8de236fd00) 00010000:00010000:0.0:1789584144.484866:0:24708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789584144.484897:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8698cc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.484915:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8698cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.484929:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8698cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789584144.485305:0:24708:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b17e176d reply state 00000000bdb6506f transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8698cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.485321:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8698cc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.485347:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f8de236fd00) 00010000:00010000:0.0:1789584144.485350:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1789584144.485354:0:24708:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789584144.485365:0:24708:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789584144.485468:0:24708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2408ec3-193f-4ced-b3de-620548852bdb+9:19030:x1876514228568320:12345-192.168.204.11@tcp:36:lfs.0 Request processed in 753us (1033us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1789584144.485960:0:24708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00100000:2.0:1789584144.489010:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584144.489140:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228568576 00000100:00100000:1.0:1789584144.489154:0:21949:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228568576 00000100:00100000:1.0:1789584144.489270:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:1.0:1789584144.489282:0:21949:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2408ec3-193f-4ced-b3de-620548852bdb+9:19030:x1876514228568576:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:1.0:1789584144.489648:0:21949:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2408ec3-193f-4ced-b3de-620548852bdb+10:19030:x1876514228568576:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 367us (664us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1789584144.489657:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:2.0:1789584144.504100:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584144.504339:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228568832 00000100:00100000:0.0:1789584144.504354:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228568832 00000100:00100000:0.0:1789584144.504449:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:0.0:1789584144.504461:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2408ec3-193f-4ced-b3de-620548852bdb+10:19030:x1876514228568832:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:0.0:1789584144.504678:0:21945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789584144.504710:0:21945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f000/0x113b6add9f8698d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee2ca expref: -99 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.504828:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f8698da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.504852:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f8698da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.504870:0:21945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f8698da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.504883:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f8698e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.504892:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f8698e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.504924:0:21945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f8698e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789584144.505588:0:21945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789584144.505731:0:21945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f8698da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505742:0:21945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f8698da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505750:0:21945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f8698da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505756:0:21945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5fc00 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:0.0:1789584144.505761:0:21945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f8698da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505770:0:21945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f8698da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505786:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8dda0a5f00) 00010000:00010000:0.0:1789584144.505789:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789584144.505795:0:21945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f8698da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505802:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f8698da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505819:0:21945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f8698e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505843:0:21945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f8698e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505849:0:21945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f8698e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505855:0:21945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5e000 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:0.0:1789584144.505858:0:21945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f8698e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505865:0:21945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f8698e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505874:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8f8dc785d100) 00010000:00010000:0.0:1789584144.505877:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789584144.505881:0:21945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f8698e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505887:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f8698e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505938:0:21945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f000/0x113b6add9f8698d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2ca expref: 12 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505950:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8dda0a5f00) 00010000:00010000:0.0:1789584144.505953:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789584144.505956:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f000/0x113b6add9f8698d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2ca expref: 12 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.505978:0:21945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8defc5f000, rc 0) 00000100:00100000:0.0:1789584144.508646:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2408ec3-193f-4ced-b3de-620548852bdb+11:19030:x1876514228568832:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 4164us (4541us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1789584144.508669:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:3.0:1789584144.516397:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584144.516534:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228568960 00000100:00100000:1.0:1789584144.516584:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228568960 00000100:00100000:1.0:1789584144.516732:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00100000:1.0:1789584144.516746:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2408ec3-193f-4ced-b3de-620548852bdb+11:19030:x1876514228568960:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1789584144.516792:0:21946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584144.516821:0:21946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f8698ef lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee2d1 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.516943:0:21946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698f6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.516961:0:21946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.516975:0:21946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789584144.517008:0:21946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789584144.517023:0:21946:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789584144.517048:0:21946:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.517090:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f8698ef lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2d1 expref: 13 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.517112:0:21946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2d1 expref: 12 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.517121:0:21946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f8de236fd00) 00010000:00010000:1.0:1789584144.517124:0:21946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789584144.517129:0:21946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8ded95d600, rc 0) 00000100:00100000:1.0:1789584144.517251:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2408ec3-193f-4ced-b3de-620548852bdb+12:19030:x1876514228568960:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 507us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584144.517260:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00100000:2.0:1789584144.522410:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584144.522669:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228569088 00000100:00100000:1.0:1789584144.522684:0:21949:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228569088 00000100:00100000:1.0:1789584144.522826:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:1.0:1789584144.522840:0:21949:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2408ec3-193f-4ced-b3de-620548852bdb+12:19030:x1876514228569088:12345-192.168.204.11@tcp:37:lfs.0 00000100:00100000:3.0:1789584144.542948:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584144.543235:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228569344 00000100:00100000:1.0:1789584144.543251:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228569344 00000100:00100000:1.0:1789584144.543339:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00100000:1.0:1789584144.543352:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+5:2402:x1876514228569344:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789584144.543482:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584144.545674:0:23257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228569600 00000100:00100000:2.0:1789584144.545695:0:23257:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228569600 00000100:00100000:2.0:1789584144.546009:0:23257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:2.0:1789584144.546041:0:23257:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:319b0417-2da6-48eb-878f-de6e4d622177+5:2402:x1876514228569600:12345-192.168.204.11@tcp:400:kworker.0 00000100:00080000:0.0:1789584144.548104:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789584144.549917:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+5:2402:x1876514228569344:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 6539us (6959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584144.549942:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00100000:3.0:1789584144.552279:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584144.552339:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584144.552377:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584144.552403:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584144.554164:0:23255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228569856 00000100:00100000:1.0:1789584144.554213:0:23255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228569856 00000100:00100000:1.0:1789584144.554302:0:23255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228569472 00000100:00100000:1.0:1789584144.554306:0:23255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228569472 00000100:00100000:3.0:1789584144.554317:0:23759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228569728 00000100:00100000:3.0:1789584144.554322:0:23759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228569728 00000100:00100000:1.0:1789584144.554335:0:23255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:1.0:1789584144.554346:0:23255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2408ec3-193f-4ced-b3de-620548852bdb+5:2402:x1876514228569856:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789584144.554347:0:23759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:3.0:1789584144.554352:0:23759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:319b0417-2da6-48eb-878f-de6e4d622177+5:2402:x1876514228569472:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1789584144.554455:0:24195:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:0.0:1789584144.554467:0:24195:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00000100:00100000:0.0:1789584144.554503:0:23258:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:0.0:1789584144.554513:0:23258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:0.0:1789584144.554521:0:23258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2408ec3-193f-4ced-b3de-620548852bdb+5:2402:x1876514228569728:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1789584144.557880:0:23257:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:319b0417-2da6-48eb-878f-de6e4d622177+5:2402:x1876514228569600:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 11827us (14376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584144.557902:0:23257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:1.0:1789584144.558321:0:23255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2408ec3-193f-4ced-b3de-620548852bdb+5:2402:x1876514228569856:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 3972us (6060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584144.558332:0:23255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00080000:1.0:1789584144.559855:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789584144.559866:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789584144.560879:0:23759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:319b0417-2da6-48eb-878f-de6e4d622177+5:2402:x1876514228569472:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 6510us (8486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584144.560896:0:23759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:0.0:1789584144.560898:0:23258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2408ec3-193f-4ced-b3de-620548852bdb+5:2402:x1876514228569728:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 6376us (8491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584144.560906:0:23258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:2.0:1789584144.562839:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228569216 00000100:00100000:2.0:1789584144.562859:0:21938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228569216 00000100:00100000:2.0:1789584144.562948:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 164 00000100:00100000:2.0:1789584144.562960:0:21938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+13:2402:x1876514228569216:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1789584144.563083:0:21938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98df0fde-e9b8-4032-b372-dfd508e8b711+13:2402:x1876514228569216:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 124us (10743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584144.563112:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 164 00000100:00100000:1.0:1789584144.565256:0:21949:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2408ec3-193f-4ced-b3de-620548852bdb+12:19030:x1876514228569088:12345-192.168.204.11@tcp:37:lfs.0 Request processed in 42395us (42836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584144.565295:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:2.0:1789584144.571865:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584144.572123:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228570112 00000100:00100000:1.0:1789584144.572137:0:21948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228570112 00000100:00100000:1.0:1789584144.572244:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:1.0:1789584144.572259:0:21948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc73e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2408ec3-193f-4ced-b3de-620548852bdb+12:19030:x1876514228570112:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:1.0:1789584144.573818:0:21948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc73e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2408ec3-193f-4ced-b3de-620548852bdb+13:19030:x1876514228570112:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 1441us (1849us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1789584144.573841:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 4 00000040:00080000:0.0:1789584144.607004:0:22601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789584144.655997:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584144.656251:0:24708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228570240 00000100:00100000:0.0:1789584144.656266:0:24708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228570240 00000100:00100000:0.0:1789584144.656346:0:24708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 36 00000100:00100000:0.0:1789584144.656359:0:24708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+11:19037:x1876514228570240:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:0.0:1789584144.656388:0:24708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789584144.656418:0:24708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f8698fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee2d8 expref: -99 pid: 24708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.656510:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f869904 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.656530:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f869904 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.656566:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f869904 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.656580:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ec00/0x113b6add9f86990b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.656589:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ec00/0x113b6add9f86990b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.656596:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ec00/0x113b6add9f86990b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.657079:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ee00/0x113b6add9f869912 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.657093:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ee00/0x113b6add9f869912 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.657102:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ee00/0x113b6add9f869912 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789584144.657140:0:24708:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789584144.657145:0:24708:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789584144.663335:0:24708:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ee00/0x113b6add9f869912 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663463:0:24708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f869904 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663664:0:24708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f869904 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663676:0:24708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f869904 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663683:0:24708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5fc00 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:2.0:1789584144.663689:0:24708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f869904 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663701:0:24708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f869904 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663726:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8dda0a5f00) 00010000:00010000:2.0:1789584144.663729:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789584144.663736:0:24708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f869904 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663742:0:24708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5fc00/0x113b6add9f869904 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663768:0:24708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ec00/0x113b6add9f86990b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663800:0:24708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ec00/0x113b6add9f86990b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663806:0:24708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ec00/0x113b6add9f86990b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663812:0:24708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5ec00 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:2.0:1789584144.663815:0:24708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ec00/0x113b6add9f86990b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663822:0:24708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ec00/0x113b6add9f86990b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663832:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8f8dc785d100) 00010000:00010000:2.0:1789584144.663835:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789584144.663839:0:24708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ec00/0x113b6add9f86990b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663845:0:24708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ec00/0x113b6add9f86990b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663912:0:24708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f8698fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2d8 expref: 13 pid: 24708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663930:0:24708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ee00/0x113b6add9f869912 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2d8 expref: 12 pid: 24708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.663938:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f8de236fd00) 00010000:00010000:2.0:1789584144.663941:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789584144.663952:0:24708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8defc5ee00, rc 0) 00000100:00100000:2.0:1789584144.664149:0:24708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+12:19037:x1876514228570240:12345-192.168.204.11@tcp:101:bash.0 Request processed in 7789us (8165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584144.664160:0:24708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 36 00000100:00100000:2.0:1789584144.668096:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584144.668773:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228570368 00000100:00100000:0.0:1789584144.668788:0:21957:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228570368 00000100:00100000:0.0:1789584144.668934:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:0.0:1789584144.668948:0:21957:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfce3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:319b0417-2da6-48eb-878f-de6e4d622177+5:19037:x1876514228570368:12345-192.168.204.11@tcp:900:bash.0 00000100:00100000:0.0:1789584144.669083:0:21957:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfce3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:319b0417-2da6-48eb-878f-de6e4d622177+5:19037:x1876514228570368:12345-192.168.204.11@tcp:900:bash.0 Request processed in 138us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584144.669091:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:0.0:1789584144.672447:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584144.672562:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228570624 00000100:00100000:2.0:1789584144.672586:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228570624 00000100:00100000:2.0:1789584144.672664:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 37 00000100:00100000:2.0:1789584144.672675:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+12:19037:x1876514228570624:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:2.0:1789584144.672704:0:21945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584144.672733:0:21945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f869919 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee2df expref: -99 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.672917:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869920 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.672937:0:21945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698f6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2d1 expref: 12 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.672948:0:21945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869920 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.672993:0:21945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2d1 expref: 12 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.673022:0:21945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698f6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2d1 expref: 12 pid: 21946 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584144.673039:0:21945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfce3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21945:1876514253862272:192.168.204.11@tcp:104: 00000100:00100000:2.0:1789584144.673234:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc3eb0840 going to sleep for 11 seconds 00000100:00100000:2.0:1789584144.681656:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584144.681848:0:21945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfce3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21945:1876514253862272:192.168.204.11@tcp:104: 00010000:00010000:0.0:1789584144.681889:0:21945:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869920 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584144.682028:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228570752 00000100:00100000:1.0:1789584144.682038:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228570752 00010000:00010000:1.0:1789584144.682090:0:21931:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698f6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2d1 expref: 13 pid: 21946 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584144.682138:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:1.0:1789584144.682150:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2408ec3-193f-4ced-b3de-620548852bdb+13:2400:x1876514228570752:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789584144.682170:0:21931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789584144.682178:0:21931:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698f6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2d1 expref: 13 pid: 21946 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.682294:0:21931:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2d1 expref: 13 pid: 21946 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.682325:0:21931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f8698f6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2d1 expref: 13 pid: 21946 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.682344:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f8de236fd00) 00010000:00010000:1.0:1789584144.682489:0:21931:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869920 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.682502:0:21931:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869920 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.682511:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869920 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.682724:0:21931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789584144.682808:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2408ec3-193f-4ced-b3de-620548852bdb+12:2400:x1876514228570752:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 659us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584144.682818:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 16 00010000:00010000:0.0:1789584144.684760:0:21945:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869920 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.684783:0:21945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869920 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.684940:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f869927 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.684959:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f869927 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.684974:0:21945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f869927 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.692071:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f86992e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.692104:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f86992e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.692124:0:21945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f86992e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789584144.692141:0:21945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789584144.692301:0:21945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869920 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.692310:0:21945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869920 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.692316:0:21945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869920 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.692323:0:21945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c61800 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:1.0:1789584144.692328:0:21945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869920 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.692337:0:21945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869920 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.692353:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f8de236fd00) 00010000:00010000:1.0:1789584144.692430:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789584144.692439:0:21945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869920 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.692447:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869920 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789584144.692465:0:21945:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5fb5836 reply state 00000000daadda87 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f869927 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.692709:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f869927 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.692717:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8f8de7836000) 00010000:00010000:1.0:1789584144.692720:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789584144.692733:0:21945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789584144.692796:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f869919 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2df expref: 15 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.692816:0:21945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f86992e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2df expref: 14 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.692824:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:1.0:1789584144.692827:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789584144.692829:0:21945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8ded95d800, rc 0) 00000100:00100000:1.0:1789584144.692982:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+15:19037:x1876514228570624:12345-192.168.204.11@tcp:101:bash.0 Request processed in 20307us (20551us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1789584144.692993:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 37 00000100:00100000:2.0:1789584144.710671:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584144.711094:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228570880 00000100:00100000:1.0:1789584144.711108:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228570880 00000100:00100000:1.0:1789584144.711232:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 38 00000100:00100000:1.0:1789584144.711245:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+15:19037:x1876514228570880:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:1.0:1789584144.711279:0:21946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584144.711310:0:21946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f86993c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee2e6 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.711410:0:21946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f869943 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.711428:0:21946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f869943 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.711442:0:21946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f869943 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789584144.711528:0:21946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789584144.711534:0:21946:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789584144.711685:0:21946:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f869943 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.711703:0:21946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f869943 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.711738:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f86993c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2e6 expref: 17 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.711762:0:21946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f869943 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2e6 expref: 16 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.711771:0:21946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:1.0:1789584144.711774:0:21946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789584144.711779:0:21946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8ded95d000, rc 0) 00000100:00100000:1.0:1789584144.711871:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+16:19037:x1876514228570880:12345-192.168.204.11@tcp:101:bash.0 Request processed in 628us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584144.711879:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 38 00000100:00100000:2.0:1789584144.716125:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584144.716277:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228571136 00000100:00100000:1.0:1789584144.716291:0:21948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228571136 00000100:00100000:1.0:1789584144.716370:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:1.0:1789584144.716382:0:21948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:319b0417-2da6-48eb-878f-de6e4d622177+16:19037:x1876514228571136:12345-192.168.204.11@tcp:35:bash.0 00000100:00100000:1.0:1789584144.716888:0:21948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:319b0417-2da6-48eb-878f-de6e4d622177+17:19037:x1876514228571136:12345-192.168.204.11@tcp:35:bash.0 Request processed in 505us (775us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1789584144.716897:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:3.0:1789584144.804232:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584144.804316:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228571392 00000100:00100000:1.0:1789584144.804330:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228571392 00000100:00100000:1.0:1789584144.804425:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:1.0:1789584144.804438:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+17:19047:x1876514228571392:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1789584144.804472:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584144.804500:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f86994a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee2ed expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789584144.804643:0:21947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789584144.804816:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f86994a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2ed expref: 19 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.804835:0:21947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8dda0a5f00) 00010000:00010000:1.0:1789584144.804838:0:21947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789584144.804844:0:21947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f86994a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2ed expref: 19 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.804861:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8ded95d600, rc 0) 00000100:00100000:1.0:1789584144.804939:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+18:19047:x1876514228571392:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 503us (721us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1789584144.804947:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:3.0:1789584144.809320:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584144.809462:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228571648 00000100:00100000:1.0:1789584144.809485:0:21948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228571648 00000100:00100000:1.0:1789584144.810141:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:1.0:1789584144.810159:0:21948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:319b0417-2da6-48eb-878f-de6e4d622177+18:19047:x1876514228571648:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:1.0:1789584144.810619:0:21948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:319b0417-2da6-48eb-878f-de6e4d622177+19:19047:x1876514228571648:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 463us (1312us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1789584144.810650:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:2.0:1789584144.889456:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584144.889808:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228571904 00000100:00100000:1.0:1789584144.889822:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228571904 00000100:00100000:1.0:1789584144.889900:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:1.0:1789584144.889913:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+19:19050:x1876514228571904:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1789584144.889947:0:21946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584144.889978:0:21946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f869958 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee2f4 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.890134:0:21946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f86995f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.890152:0:21946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f86995f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584144.890168:0:21946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f86995f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789584144.890181:0:21946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789584144.890490:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d600/0x113b6add9f869958 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2f4 expref: 22 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.890515:0:21946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f86995f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2f4 expref: 21 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584144.890525:0:21946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:2.0:1789584144.890529:0:21946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789584144.890533:0:21946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8ded95dc00, rc 0) 00000100:00100000:2.0:1789584144.890896:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+21:19050:x1876514228571904:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 985us (1453us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1789584144.890905:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:3.0:1789584144.893818:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584144.895510:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228572160 00000100:00100000:0.0:1789584144.895532:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228572160 00000100:00100000:2.0:1789584144.896293:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584144.896977:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228572032 00000100:00100000:3.0:1789584144.896988:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228572032 00000100:00100000:3.0:1789584144.897729:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 41 00000100:00100000:3.0:1789584144.897744:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+22:19050:x1876514228572032:12345-192.168.204.11@tcp:54:lfs.0 00010000:00010000:3.0:1789584144.897844:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f86996d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.897868:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f86996d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.897883:0:21945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f86996d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.897921:0:21945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f86996d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.897951:0:21945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f86996d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.897959:0:21945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f86996d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.897964:0:21945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8e00 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:3.0:1789584144.897969:0:21945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f86996d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.897977:0:21945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f86996d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.897992:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:3.0:1789584144.897996:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789584144.898001:0:21945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f86996d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584144.898020:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f86996d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584144.898120:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:0.0:1789584144.898133:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:319b0417-2da6-48eb-878f-de6e4d622177+22:2401:x1876514228572160:12345-192.168.204.11@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789584144.898134:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+22:19050:x1876514228572032:12345-192.168.204.11@tcp:54:lfs.0 Request processed in 396us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584144.898143:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 41 00010000:00010000:0.0:1789584144.898151:0:21930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789584144.898172:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f86995f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2f4 expref: 21 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584144.898209:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:0.0:1789584144.898213:0:21930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789584144.898237:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:319b0417-2da6-48eb-878f-de6e4d622177+20:2401:x1876514228572160:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 108us (4436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584144.898244:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:3.0:1789584144.900910:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584144.900962:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228572416 00000100:00100000:3.0:1789584144.900974:0:21949:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228572416 00000100:00100000:3.0:1789584144.901047:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:3.0:1789584144.901058:0:21949:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:319b0417-2da6-48eb-878f-de6e4d622177+20:19050:x1876514228572416:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:3.0:1789584144.901472:0:21949:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:319b0417-2da6-48eb-878f-de6e4d622177+21:19050:x1876514228572416:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 413us (571us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1789584144.901481:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00010000:00010000:1.0:1789584145.052232:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789584145.296370:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584145.296508:0:24708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228572672 00000100:00100000:3.0:1789584145.296524:0:24708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228572672 00000100:00100000:3.0:1789584145.296611:0:24708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 42 00000100:00100000:3.0:1789584145.296624:0:24708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+21:19081:x1876514228572672:12345-192.168.204.11@tcp:101:cat.0 00010000:00010000:3.0:1789584145.296662:0:24708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789584145.296707:0:24708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9a00/0x113b6add9f869974 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee2fb expref: -99 pid: 24708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584145.296859:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f86997b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584145.296877:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f86997b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584145.296891:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f86997b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789584145.296904:0:24708:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789584145.297139:0:24708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9a00/0x113b6add9f869974 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2fb expref: 24 pid: 24708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584145.297163:0:24708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f86997b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2fb expref: 23 pid: 24708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584145.297172:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:3.0:1789584145.297271:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789584145.297276:0:24708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8df4fe8e00, rc 0) 00000100:00100000:3.0:1789584145.297367:0:24708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+23:19081:x1876514228572672:12345-192.168.204.11@tcp:101:cat.0 Request processed in 745us (1026us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1789584145.297375:0:24708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 42 00000100:00100000:3.0:1789584145.305333:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584145.305486:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228572928 00000100:00100000:2.0:1789584145.305501:0:21949:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228572928 00000100:00100000:2.0:1789584145.305668:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:2.0:1789584145.305683:0:21949:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:319b0417-2da6-48eb-878f-de6e4d622177+23:19081:x1876514228572928:12345-192.168.204.11@tcp:35:cat.0 00000100:00100000:2.0:1789584145.306871:0:21949:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:319b0417-2da6-48eb-878f-de6e4d622177+24:19081:x1876514228572928:12345-192.168.204.11@tcp:35:cat.0 Request processed in 863us (1225us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1789584145.306886:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:0.0:1789584145.311375:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584145.311963:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228573056 00000100:00100000:3.0:1789584145.311979:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228573056 00000100:00100000:3.0:1789584145.312090:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:3.0:1789584145.312102:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:319b0417-2da6-48eb-878f-de6e4d622177+24:2400:x1876514228573056:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789584145.312126:0:21931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789584145.312162:0:21931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f86997b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2fb expref: 24 pid: 24708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584145.312245:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:3.0:1789584145.312253:0:21931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789584145.312326:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:319b0417-2da6-48eb-878f-de6e4d622177+23:2400:x1876514228573056:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 226us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584145.312334:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:1.0:1789584145.372233:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfc88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253862400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789584145.372345:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584145.372690:0:23259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253862400 00000100:00100000:3.0:1789584145.372711:0:23259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253862400 00000100:00100000:3.0:1789584145.372795:0:23259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789584145.372810:0:23259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253862400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789584145.372856:0:23259:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789584145.372921:0:23259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253862400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584145.372928:0:23259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789584145.373021:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfc88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253862400:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789584145.373175:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789584145.374263:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789584145.374288:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253862528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789584145.374357:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584145.374886:0:23260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253862528 00000100:00100000:1.0:1789584145.374896:0:23260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253862528 00000100:00100000:1.0:1789584145.374974:0:23260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789584145.374985:0:23260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253862528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789584145.375026:0:23260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789584145.375105:0:23260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876514253862528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584145.375112:0:23260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1789584145.376209:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789584145.376377:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3456:1876514253862528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789584145.403016:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584145.403968:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228573312 00000100:00100000:1.0:1789584145.403987:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228573312 00000100:00100000:1.0:1789584145.404087:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 43 00000100:00100000:1.0:1789584145.404100:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc88ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+23:19087:x1876514228573312:12345-192.168.204.11@tcp:101:dd.0 00010000:00010000:1.0:1789584145.404137:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584145.404168:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95ce00/0x113b6add9f869989 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee302 expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.404362:0:21947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f869990 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.404380:0:21947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f86992e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2df expref: 24 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.404388:0:21947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f869943 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2e6 expref: 24 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.404398:0:21947:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f869990 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.404445:0:21947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f869943 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2e6 expref: 24 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.404463:0:21947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f869943 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2e6 expref: 24 pid: 21946 timeout: 898 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584145.404504:0:21947:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21947:1876514253862656:192.168.204.11@tcp:104: 00010000:00010000:1.0:1789584145.404870:0:21947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f86992e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2df expref: 24 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.404880:0:21947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f86992e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2df expref: 24 pid: 21945 timeout: 898 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584145.404891:0:21947:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21947:1876514253862784:192.168.204.11@tcp:104: 00000100:00100000:1.0:1789584145.404918:0:21947:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df7613a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789584145.411927:0:21947:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21947:1876514253862656:192.168.204.11@tcp:104: 00000100:00100000:1.0:1789584145.411950:0:21947:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21947:1876514253862784:192.168.204.11@tcp:104: 00010000:00010000:1.0:1789584145.411983:0:21947:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f869990 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584145.414561:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584145.414709:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584145.414970:0:21983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228573440 00000100:00100000:1.0:1789584145.414985:0:21983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228573440 00010000:00010000:1.0:1789584145.415050:0:21983:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f869943 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2e6 expref: 25 pid: 21946 timeout: 898 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584145.415107:0:21983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228573568 00000100:00100000:1.0:1789584145.415111:0:21983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228573568 00010000:00010000:1.0:1789584145.415126:0:21983:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f86992e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2df expref: 26 pid: 21945 timeout: 898 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584145.415166:0:21983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:1.0:1789584145.415225:0:21983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:319b0417-2da6-48eb-878f-de6e4d622177+26:2400:x1876514228573440:12345-192.168.204.11@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789584145.415233:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:2.0:1789584145.415250:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc6decc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:319b0417-2da6-48eb-878f-de6e4d622177+26:2399:x1876514228573568:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789584145.415256:0:21983:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789584145.415263:0:21932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789584145.415268:0:21983:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f869943 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2e6 expref: 26 pid: 21946 timeout: 898 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584145.415274:0:21932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f86992e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2df expref: 26 pid: 21945 timeout: 898 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.415294:0:21983:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f869943 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2e6 expref: 26 pid: 21946 timeout: 898 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584145.415877:0:21932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f86992e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2df expref: 26 pid: 21945 timeout: 898 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584145.415908:0:21932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d800/0x113b6add9f86992e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2df expref: 26 pid: 21945 timeout: 898 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584145.415930:0:21932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:2.0:1789584145.415936:0:21932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f869990 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584145.415947:0:21932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f869990 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584145.415955:0:21932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789584145.416050:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc6decc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:319b0417-2da6-48eb-878f-de6e4d622177+25:2399:x1876514228573568:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 806us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584145.416059:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00010000:00010000:1.0:1789584145.416279:0:21983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f869943 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee2e6 expref: 24 pid: 21946 timeout: 898 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.416292:0:21983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:1.0:1789584145.416296:0:21983:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f869990 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.416307:0:21983:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f869990 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.416450:0:21983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f869990 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.416488:0:21983:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789584145.416519:0:21983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:319b0417-2da6-48eb-878f-de6e4d622177+23:2400:x1876514228573440:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 1335us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584145.416527:0:21983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 17 00010000:00010000:2.0:1789584145.420974:0:21947:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f869990 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584145.421011:0:21947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f869990 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789584145.421070:0:21947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789584145.421354:0:21947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95ce00/0x113b6add9f869989 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee302 expref: 24 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584145.421380:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95dc00/0x113b6add9f869990 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee302 expref: 23 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584145.421391:0:21947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:2.0:1789584145.421394:0:21947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789584145.421398:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8ded95dc00, rc 0) 00000100:00100000:2.0:1789584145.421490:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc88ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+23:19087:x1876514228573312:12345-192.168.204.11@tcp:101:dd.0 Request processed in 17392us (18504us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1789584145.421499:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 43 00000100:00100000:3.0:1789584145.425756:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584145.425831:0:24708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228573824 00000100:00100000:2.0:1789584145.425845:0:24708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228573824 00000100:00100000:2.0:1789584145.425937:0:24708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 44 00000100:00100000:2.0:1789584145.425950:0:24708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+23:19087:x1876514228573824:12345-192.168.204.11@tcp:36:dd.0 00010000:00010000:2.0:1789584145.426423:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60600/0x113b6add9f86999e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584145.426447:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60600/0x113b6add9f86999e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584145.426462:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60600/0x113b6add9f86999e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789584145.426551:0:24708:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1789584145.426608:0:24708:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001712e47b reply state 000000004563039b transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60600/0x113b6add9f86999e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584145.426637:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60600/0x113b6add9f86999e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584145.426647:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:2.0:1789584145.426650:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789584145.426655:0:24708:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789584145.426784:0:24708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+26:19087:x1876514228573824:12345-192.168.204.11@tcp:36:dd.0 Request processed in 834us (1042us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1789584145.426793:0:24708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 44 00000020:00080000:2.0:1789584145.426799:0:24708:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789584145.430511:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584145.430579:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228573952 00000100:00100000:3.0:1789584145.430594:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228573952 00000100:00100000:0.0:1789584145.430776:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 45 00000100:00100000:0.0:1789584145.430790:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+26:19087:x1876514228573952:12345-192.168.204.11@tcp:101:dd.0 00010000:00010000:0.0:1789584145.430842:0:21945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789584145.430871:0:21945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f200/0x113b6add9f8699a5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee309 expref: -99 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584145.430954:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f200/0x113b6add9f8699a5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee309 expref: 27 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584145.430973:0:21945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f200/0x113b6add9f8699a5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee309 expref: 27 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584145.431007:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:0.0:1789584145.431011:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789584145.431015:0:21945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8defc5f200, rc 0) 00000100:00100000:0.0:1789584145.431098:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+27:19087:x1876514228573952:12345-192.168.204.11@tcp:101:dd.0 Request processed in 311us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584145.431106:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 45 00000100:00100000:3.0:1789584145.446042:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584145.446278:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228574208 00000100:00100000:1.0:1789584145.446292:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228574208 00000100:00100000:1.0:1789584145.446575:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:1.0:1789584145.446590:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd728700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:319b0417-2da6-48eb-878f-de6e4d622177+27:19087:x1876514228574208:12345-192.168.204.11@tcp:103:dd.0 00010000:00010000:1.0:1789584145.446634:0:21931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789584145.446666:0:21931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f200/0x113b6add9f8699a5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee309 expref: 27 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.446692:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:1.0:1789584145.446698:0:21931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789584145.446782:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd728700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:319b0417-2da6-48eb-878f-de6e4d622177+26:19087:x1876514228574208:12345-192.168.204.11@tcp:103:dd.0 Request processed in 195us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584145.448713:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584145.448888:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:2.0:1789584145.449007:0:24708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228574336 00000100:00100000:2.0:1789584145.449018:0:24708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228574336 00000100:00100000:2.0:1789584145.449085:0:24708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00100000:2.0:1789584145.449107:0:24708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd72a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+26:19087:x1876514228574336:12345-192.168.204.11@tcp:58:dd.0 00010000:00010000:2.0:1789584145.449264:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f8699ac lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584145.449288:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f8699ac lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584145.449575:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f8699ac lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789584145.452430:0:24708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789584145.452630:0:24708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1789584145.452725:0:24708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1789584145.452985:0:24708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd72a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+26:19087:x1876514228574336:12345-192.168.204.11@tcp:58:dd.0 Request processed in 3872us (4273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584145.453010:0:24708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00100000:2.0:1789584145.458171:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584145.458464:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228574464 00000100:00100000:1.0:1789584145.458481:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228574464 00000100:00100000:1.0:1789584145.458556:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:1.0:1789584145.458569:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+26:19087:x1876514228574464:12345-192.168.204.11@tcp:101:dd.0 00010000:00010000:1.0:1789584145.458603:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584145.458633:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f8699b3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee310 expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.458714:0:21947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f8699ac lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.458728:0:21947:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f8699b3 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee310 expref: 27 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.458775:0:21947:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f8699ac lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.458794:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f8699b3 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee310 expref: 27 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.458813:0:21947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:1.0:1789584145.458817:0:21947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789584145.458822:0:21947:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f8699b3 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee310 expref: 27 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584145.458831:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8ded95d000, rc 0) 00000100:00100000:1.0:1789584145.458917:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+27:19087:x1876514228574464:12345-192.168.204.11@tcp:101:dd.0 Request processed in 349us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584145.458926:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:1.0:1789584145.884877:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd72b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253862912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789584145.884975:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584145.885408:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789584145.885418:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253863040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789584145.885465:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584145.885600:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253862912 00000100:00100000:0.0:1789584145.885613:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253862912 00000100:00100000:0.0:1789584145.885678:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253863040 00000100:00100000:0.0:1789584145.885681:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253863040 00000100:00100000:0.0:1789584145.885700:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789584145.885710:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253862912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789584145.885765:0:21951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789584145.885824:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876514253862912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584145.885832:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789584145.885865:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789584145.885889:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253863040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789584145.885913:0:21951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789584145.885942:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3454:x1876514253863040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584145.885949:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789584145.886115:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3454:1876514253863040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789584145.886130:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd72b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3454:1876514253862912:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789584146.078163:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584146.395652:0:3456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd72a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253863168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789584146.395780:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584146.395897:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253863296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789584146.395955:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584146.396006:0:23260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253863168 00000100:00100000:1.0:1789584146.396016:0:23260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253863168 00000100:00100000:1.0:1789584146.396079:0:23260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253863296 00000100:00100000:1.0:1789584146.396083:0:23260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253863296 00000100:00100000:1.0:1789584146.396108:0:23260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789584146.396120:0:23260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253863168:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789584146.396129:0:24655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789584146.396143:0:24655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253863296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789584146.396165:0:23260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00002000:00000024:3.0:1789584146.396167:0:24655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789584146.396248:0:23260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876514253863168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584146.396256:0:24655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253863296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584146.396261:0:23260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789584146.396270:0:24655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789584146.396293:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789584146.396367:0:3454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd72b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253863424:0@lo:400:kworker.0 00000100:00100000:3.0:1789584146.396442:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253863808:0@lo:400:kworker.0 00000100:00100000:2.0:1789584146.396967:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253863552:0@lo:400:kworker.0 00000100:00100000:1.0:1789584146.397002:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584146.400472:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584146.400554:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3457:1876514253864320:0@lo:400:kworker.0 00000100:00100000:3.0:1789584146.400606:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584146.401078:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253863296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789584146.401426:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584146.401472:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd72bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3455:1876514253864064:0@lo:400:kworker.0 00000100:00100000:2.0:1789584146.401504:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584146.401527:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789584146.401534:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876514253863936:0@lo:400:kworker.0 00000100:00100000:2.0:1789584146.401555:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584146.401574:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd72b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3455:1876514253864448:0@lo:400:kworker.0 00000100:00100000:2.0:1789584146.401596:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584146.401629:0:21937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253863424 00000100:00100000:2.0:1789584146.401639:0:21937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253863424 00000100:00100000:2.0:1789584146.401831:0:21937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789584146.401912:0:21937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:3454:x1876514253863424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584146.401988:0:21937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa65f00b-b8fe-4140-826f-6ec0a7b17af3+24:3454:x1876514253863424:12345-0@lo:400:kworker.0 Request processed in 71us (4977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584146.402580:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789584146.402595:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3457:1876514253863680:0@lo:400:kworker.0 00000100:00100000:3.0:1789584146.402637:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584146.402654:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3457:1876514253864192:0@lo:400:kworker.0 00000100:00100000:3.0:1789584146.402672:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584146.402908:0:21937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789584146.403433:0:23257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253863808 00000100:00100000:2.0:1789584146.403444:0:23257:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253863808 00000100:00100000:2.0:1789584146.403488:0:23257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253863552 00000100:00100000:2.0:1789584146.403491:0:23257:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253863552 00000100:00100000:2.0:1789584146.403512:0:23257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789584146.403521:0:23257:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253863808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584146.404449:0:23257:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253863808:12345-0@lo:400:kworker.0 Request processed in 921us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584146.404460:0:23257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789584146.404498:0:23257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789584146.404510:0:23257:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253863552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789584146.404559:0:23257:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253863552:12345-0@lo:400:kworker.0 Request processed in 54us (3134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584146.404583:0:23257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789584146.404641:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253863552:0@lo:400:kworker.0 00000100:00100000:0.0:1789584146.404812:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253864320 00000100:00100000:0.0:1789584146.404820:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253864320 00000100:00100000:0.0:1789584146.404868:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253864064 00000100:00100000:0.0:1789584146.404872:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253864064 00000100:00100000:2.0:1789584146.404927:0:3456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd72a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3456:1876514253863168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789584146.405684:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253863936 00000100:00100000:0.0:1789584146.405693:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253863936 00000100:00100000:0.0:1789584146.405857:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253864448 00000100:00100000:0.0:1789584146.405862:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253864448 00000100:00100000:0.0:1789584146.405879:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253863680 00000100:00100000:0.0:1789584146.405882:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253863680 00000100:00100000:0.0:1789584146.406422:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253864192 00000100:00100000:0.0:1789584146.406427:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253864192 00000100:00100000:0.0:1789584146.406454:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789584146.406466:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd72aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3457:x1876514253864320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584146.406568:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd72aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3457:x1876514253864320:12345-0@lo:400:kworker.0 Request processed in 104us (5960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584146.406575:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789584146.406593:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789584146.406600:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876514253864064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584146.406642:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876514253864064:12345-0@lo:400:kworker.0 Request processed in 43us (5137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584146.406648:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789584146.406661:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789584146.406667:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876514253863936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584146.406716:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876514253863936:12345-0@lo:400:kworker.0 Request processed in 49us (5160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584146.406723:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789584146.406736:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789584146.406742:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876514253864448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584146.406775:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876514253864448:12345-0@lo:400:kworker.0 Request processed in 33us (5178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584146.406781:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789584146.406792:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789584146.406797:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd72b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3457:x1876514253863680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584146.406830:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd72b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3457:x1876514253863680:12345-0@lo:400:kworker.0 Request processed in 33us (4193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584146.406836:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789584146.406848:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789584146.406854:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3457:x1876514253864192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789584146.406883:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3457:x1876514253864192:12345-0@lo:400:kworker.0 Request processed in 29us (4210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584146.407318:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789584146.407818:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789584146.407826:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789584146.410420:0:3454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd72b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa65f00b-b8fe-4140-826f-6ec0a7b17af3:3454:1876514253863424:0@lo:400:kworker.0 00010000:00080000:3.0:1789584146.411132:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dfd729f80 x1876514253864192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584146.411151:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3457:1876514253864192:0@lo:400:kworker.0 00000100:00100000:3.0:1789584146.411171:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253863808:0@lo:400:kworker.0 00000100:00100000:3.0:1789584146.411208:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3457:1876514253864320:0@lo:400:kworker.0 00000100:00100000:3.0:1789584146.411242:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3457:1876514253863680:0@lo:400:kworker.0 00000100:00100000:3.0:1789584146.411291:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876514253863936:0@lo:400:kworker.0 00010000:00080000:3.0:1789584146.412582:0:3455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8dfd72b100 x1876514253864448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789584162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789584146.412600:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd72b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3455:1876514253864448:0@lo:400:kworker.0 00000100:00100000:3.0:1789584146.412613:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd72bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3455:1876514253864064:0@lo:400:kworker.0 00000040:00080000:2.0:1789584146.461967:0:21981:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789584146.461993:0:21981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789584146.462048:0:21981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789584146.462063:0:21981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1789584146.462267:0:21981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfc9f9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:21981:1876514253864576:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789584146.462391:0:21981:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc7ed16c0 going to sleep for 11 seconds 00000001:00080000:3.0:1789584146.482072:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901894 is committed 00000001:00080000:3.0:1789584146.482099:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901889 is committed 00000001:00080000:3.0:1789584146.482124:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901899 is committed 00000001:00080000:3.0:1789584146.482148:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:3.0:1789584146.482159:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901906 is committed 00010000:00010000:1.0:1789584146.482316:0:3440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8a00/0x113b6add9f869840 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482332:0:3440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8a00/0x113b6add9f869840 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482341:0:3440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8a00/0x113b6add9f869840 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482348:0:3440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8a00 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:1.0:1789584146.482354:0:3440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8a00/0x113b6add9f869840 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482362:0:3440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8a00/0x113b6add9f869840 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482391:0:3440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8f8dc785d100) 00010000:00010000:1.0:1789584146.482394:0:3440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789584146.482401:0:3440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8a00/0x113b6add9f869840 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482408:0:3440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8a00/0x113b6add9f869840 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482434:0:3440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61c00/0x113b6add9f869847 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482439:0:3440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61c00/0x113b6add9f869847 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482446:0:3440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61c00/0x113b6add9f869847 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482451:0:3440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c61c00 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:1.0:1789584146.482454:0:3440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61c00/0x113b6add9f869847 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482461:0:3440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61c00/0x113b6add9f869847 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482468:0:3440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f8de236fd00) 00010000:00010000:1.0:1789584146.482470:0:3440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789584146.482473:0:3440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61c00/0x113b6add9f869847 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482479:0:3440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61c00/0x113b6add9f869847 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482506:0:3440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f869927 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482513:0:3440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f869927 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482520:0:3440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f869927 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482525:0:3440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95d200 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:1.0:1789584146.482529:0:3440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f869927 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482534:0:3440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f869927 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482543:0:3440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8f8de7836000) 00010000:00010000:1.0:1789584146.482545:0:3440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789584146.482548:0:3440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f869927 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.482554:0:3440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d200/0x113b6add9f869927 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.482782:0:3441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8698cc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.482793:0:3441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8698cc lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.482801:0:3441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8698cc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.482816:0:3441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5f400 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:0.0:1789584146.482820:0:3441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8698cc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.482826:0:3441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8698cc lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.482837:0:3441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f8de236fd00) 00010000:00010000:0.0:1789584146.482840:0:3441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789584146.482844:0:3441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8698cc lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.482851:0:3441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8698cc lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.482867:0:3441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60600/0x113b6add9f86999e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584146.482877:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00010000:00010000:0.0:1789584146.482880:0:3441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60600/0x113b6add9f86999e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.482887:0:3441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60600/0x113b6add9f86999e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.482894:0:3441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c60600 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:0.0:1789584146.482898:0:3441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60600/0x113b6add9f86999e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.482905:0:3441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60600/0x113b6add9f86999e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.482925:0:3441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:0.0:1789584146.482927:0:3441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789584146.482931:0:3441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60600/0x113b6add9f86999e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.482937:0:3441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60600/0x113b6add9f86999e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584146.482965:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228574592 00000100:00100000:0.0:1789584146.482987:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228574592 00000100:00100000:1.0:1789584146.483051:0:21981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfc9f9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:21981:1876514253864576:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789584146.483072:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00100000:0.0:1789584146.483085:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd72bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+11:19088:x1876514228574592:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789584146.483127:0:21945:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789584146.483305:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd72bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+11:19088:x1876514228574592:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 221us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584146.483314:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00080000:3.0:1789584146.483491:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789584146.488612:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584146.488944:0:24708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228574720 00000100:00100000:0.0:1789584146.488961:0:24708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228574720 00000100:00100000:0.0:1789584146.489052:0:24708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 49 00000100:00100000:0.0:1789584146.489067:0:24708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+11:19088:x1876514228574720:12345-192.168.204.11@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789584146.489207:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8699ba lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489230:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8699ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489244:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8699ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489285:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e600/0x113b6add9f8699c1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489293:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e600/0x113b6add9f8699c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489300:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e600/0x113b6add9f8699c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489520:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ea00/0x113b6add9f8699c8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489532:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ea00/0x113b6add9f8699c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489539:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ea00/0x113b6add9f8699c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789584146.489591:0:24708:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789584146.489597:0:24708:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789584146.489615:0:24708:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ea00/0x113b6add9f8699c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489629:0:24708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8699ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489635:0:24708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8699ba lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489643:0:24708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8699ba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489660:0:24708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5f400 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:0.0:1789584146.489666:0:24708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8699ba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489674:0:24708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8699ba lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489689:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8dda0a5600) 00010000:00010000:0.0:1789584146.489692:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789584146.489699:0:24708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8699ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489705:0:24708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f8699ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489722:0:24708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e600/0x113b6add9f8699c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489727:0:24708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e600/0x113b6add9f8699c1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489733:0:24708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e600/0x113b6add9f8699c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489737:0:24708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5e600 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:0.0:1789584146.489740:0:24708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e600/0x113b6add9f8699c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489746:0:24708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e600/0x113b6add9f8699c1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489766:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8f8dda0a5e00) 00010000:00010000:0.0:1789584146.489769:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789584146.489772:0:24708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e600/0x113b6add9f8699c1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489778:0:24708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e600/0x113b6add9f8699c1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489794:0:24708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ea00/0x113b6add9f8699c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489801:0:24708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ea00/0x113b6add9f8699c8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489807:0:24708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ea00/0x113b6add9f8699c8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489812:0:24708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5ea00 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:0.0:1789584146.489815:0:24708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ea00/0x113b6add9f8699c8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489821:0:24708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ea00/0x113b6add9f8699c8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489828:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:0.0:1789584146.489831:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789584146.489834:0:24708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ea00/0x113b6add9f8699c8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.489840:0:24708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5ea00/0x113b6add9f8699c8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584146.490035:0:24708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+11:19088:x1876514228574720:12345-192.168.204.11@tcp:34:lhsmtool_posix.0 Request processed in 969us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584146.490045:0:24708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 49 00000100:00100000:0.0:1789584146.500584:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584146.501339:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228574976 00000100:00100000:2.0:1789584146.501356:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228574976 00000100:00100000:2.0:1789584146.501447:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 50 00000100:00100000:2.0:1789584146.501460:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+11:19088:x1876514228574976:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789584146.501488:0:21945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584146.501535:0:21945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f8699cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee317 expref: -99 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.501682:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8699d6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.501701:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8699d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.501718:0:21945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8699d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789584146.501731:0:21945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789584146.501928:0:21945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8699d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.501937:0:21945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8699d6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.501944:0:21945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8699d6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.501950:0:21945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c60400 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:2.0:1789584146.501955:0:21945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8699d6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.501964:0:21945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8699d6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.501989:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:2.0:1789584146.501993:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789584146.501999:0:21945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8699d6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.502006:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8699d6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.502054:0:21945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f8699cf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee317 expref: 13 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.502065:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f8dda0a5600) 00010000:00010000:2.0:1789584146.502067:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789584146.502071:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f8699cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee317 expref: 13 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.502093:0:21945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8dc4c61800, rc 0) 00000100:00100000:2.0:1789584146.502180:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+12:19088:x1876514228574976:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 723us (1611us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1789584146.502230:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 50 00000100:00100000:3.0:1789584146.508413:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584146.508955:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228575104 00000100:00100000:1.0:1789584146.508972:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228575104 00000100:00100000:1.0:1789584146.509076:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 51 00000100:00100000:1.0:1789584146.509091:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd72b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+12:19088:x1876514228575104:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789584146.509180:0:21947:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789584146.509667:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd72b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+12:19088:x1876514228575104:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 577us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584146.509679:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 51 00000100:00100000:1.0:1789584146.517001:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584146.517090:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228575360 00000100:00100000:2.0:1789584146.517104:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228575360 00000100:00100000:2.0:1789584146.517234:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 52 00000100:00100000:2.0:1789584146.517249:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+12:19088:x1876514228575360:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789584146.517281:0:21945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584146.517310:0:21945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f8699e4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee31e expref: -99 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789584146.518377:0:21945:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =59 00000004:00080000:2.0:1789584146.518389:0:21945:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+59 in llog 00000004:00080000:2.0:1789584146.518443:0:21945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1789584146.518807:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8699eb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.518829:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8699eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.518844:0:21945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8699eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.518926:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f8699e4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee31e expref: 15 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.518965:0:21945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8699eb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee31e expref: 14 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.518987:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f8de236f300) 00010000:00010000:2.0:1789584146.518991:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789584146.518996:0:21945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8dc4c60400, rc 0) 00000100:00100000:2.0:1789584146.519095:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+14:19088:x1876514228575360:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 1849us (2121us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1789584146.519105:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 52 00000100:00100000:0.0:1789584146.525675:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584146.527526:0:24708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228575616 00000100:00100000:1.0:1789584146.527562:0:24708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228575616 00000100:00100000:1.0:1789584146.527657:0:24708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 53 00000100:00100000:1.0:1789584146.527669:0:24708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+14:19088:x1876514228575616:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789584146.527759:0:24708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789584146.527798:0:24708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60400/0x113b6add9f8699eb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee31e expref: 14 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.527822:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f8de236f300) 00010000:00010000:1.0:1789584146.527838:0:24708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789584146.527876:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8699f9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.527894:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8699f9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.527907:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8699f9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.527925:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95cc00/0x113b6add9f869a00 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd9994983 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.527932:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95cc00/0x113b6add9f869a00 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd9994983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.527960:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95cc00/0x113b6add9f869a00 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd9994983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.528298:0:24708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8699f9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.528309:0:24708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8699f9 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.528331:0:24708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8699f9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.528338:0:24708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95c200 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:1.0:1789584146.528344:0:24708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8699f9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.528353:0:24708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8699f9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.528363:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f8de236fd00) 00010000:00010000:1.0:1789584146.528366:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789584146.528371:0:24708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8699f9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.528378:0:24708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95c200/0x113b6add9f8699f9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.528389:0:24708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95cc00/0x113b6add9f869a00 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd9994983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.528396:0:24708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95cc00/0x113b6add9f869a00 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd9994983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.528410:0:24708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95cc00/0x113b6add9f869a00 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd9994983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.528415:0:24708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95cc00 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:1.0:1789584146.528418:0:24708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95cc00/0x113b6add9f869a00 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd9994983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.528426:0:24708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95cc00/0x113b6add9f869a00 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd9994983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.528434:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xd9994983 (ffff8f8de7836000) 00010000:00010000:1.0:1789584146.528437:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789584146.528440:0:24708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95cc00/0x113b6add9f869a00 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd9994983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.528446:0:24708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95cc00/0x113b6add9f869a00 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd9994983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584146.528595:0:24708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+13:19088:x1876514228575616:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 924us (2933us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789584146.528605:0:24708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 53 00000100:00100000:3.0:1789584146.530931:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584146.531318:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228575744 00000100:00100000:0.0:1789584146.531340:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228575744 00000100:00100000:0.0:1789584146.531420:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 54 00000100:00100000:0.0:1789584146.531443:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+13:19088:x1876514228575744:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789584146.531472:0:21946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789584146.531503:0:21946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e600/0x113b6add9f869a07 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee325 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.531546:0:21946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f869a0e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.531562:0:21946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f869a0e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.531574:0:21946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f869a0e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.531706:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e600/0x113b6add9f869a07 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee325 expref: 15 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.531725:0:21946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f400/0x113b6add9f869a0e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee325 expref: 14 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.531746:0:21946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f8dda0a5e00) 00010000:00010000:0.0:1789584146.531748:0:21946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789584146.531752:0:21946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8defc5f400, rc 0) 00000100:00100000:0.0:1789584146.531835:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+14:19088:x1876514228575744:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 405us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584146.531843:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 54 00000100:00100000:1.0:1789584146.536289:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584146.536539:0:24708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228576000 00000100:00100000:0.0:1789584146.536553:0:24708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228576000 00000100:00100000:0.0:1789584146.536626:0:24708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 55 00000100:00100000:0.0:1789584146.536638:0:24708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+14:19088:x1876514228576000:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789584146.536760:0:24708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f869a15 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.536783:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f869a15 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.536796:0:24708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f869a15 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789584146.537528:0:24708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1789584146.537543:0:24708:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 799853354399ns, next at 800853351415ns, rc = 0 00000004:00010000:0.0:1789584146.537653:0:24708:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4a99603 reply state 000000008d539720 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f869a15 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.537674:0:24708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f869a15 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.537684:0:24708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f8dda0a5e00) 00010000:00010000:0.0:1789584146.537698:0:24708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789584146.537704:0:24708:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789584146.537850:0:24708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+16:19088:x1876514228576000:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 1211us (1574us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1789584146.537859:0:24708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 55 00000100:00100000:0.0:1789584146.540954:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584146.541111:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228576128 00000100:00100000:2.0:1789584146.541125:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228576128 00000100:00100000:2.0:1789584146.541228:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 56 00000100:00100000:2.0:1789584146.541242:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+16:19088:x1876514228576128:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789584146.541275:0:21945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789584146.541302:0:21945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869a1c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee32c expref: -99 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.541381:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869a1c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee32c expref: 17 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.541398:0:21945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869a1c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee32c expref: 17 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.541420:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f8dda0a5e00) 00010000:00010000:2.0:1789584146.541424:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789584146.541709:0:21945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8dc4c61800, rc 0) 00000100:00100000:2.0:1789584146.541835:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+17:19088:x1876514228576128:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 595us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584146.541844:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 56 00000100:00100000:3.0:1789584146.545303:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584146.545459:0:24195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228576256 00000100:00100000:0.0:1789584146.545474:0:24195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228576256 00000100:00100000:0.0:1789584146.545576:0:24195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:0.0:1789584146.545589:0:24195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:319b0417-2da6-48eb-878f-de6e4d622177+5:2399:x1876514228576256:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789584146.546233:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789584146.547304:0:24195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:319b0417-2da6-48eb-878f-de6e4d622177+6:2399:x1876514228576256:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 Request processed in 1707us (2007us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1789584146.547335:0:24195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:2.0:1789584146.550277:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584146.550383:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228576512 00000100:00100000:1.0:1789584146.550397:0:21948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228576512 00000100:00100000:1.0:1789584146.550483:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:1.0:1789584146.550494:0:21948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:319b0417-2da6-48eb-878f-de6e4d622177+17:19088:x1876514228576512:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789584146.550879:0:21948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:319b0417-2da6-48eb-878f-de6e4d622177+18:19088:x1876514228576512:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 385us (617us total) trans 12884901910 rc 0/0 00000100:00100000:1.0:1789584146.550906:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:0.0:1789584146.555043:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584146.555573:0:24708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228576768 00000100:00100000:1.0:1789584146.555587:0:24708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228576768 00000100:00100000:1.0:1789584146.555673:0:24708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 57 00000100:00100000:1.0:1789584146.555687:0:24708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+18:19088:x1876514228576768:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789584146.555858:0:24708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+18:19088:x1876514228576768:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 174us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584146.555866:0:24708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 57 00000100:00100000:2.0:1789584146.558850:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584146.559460:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228576896 00000100:00100000:3.0:1789584146.559475:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228576896 00000100:00100000:3.0:1789584146.559566:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 58 00000100:00100000:3.0:1789584146.559578:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+18:19088:x1876514228576896:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789584146.559607:0:21946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789584146.559634:0:21946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9a00/0x113b6add9f869a23 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee333 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.559736:0:21946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f869a2a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.559754:0:21946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f869a2a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.559769:0:21946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f869a2a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789584146.559821:0:21946:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789584146.559849:0:21946:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f869a2a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.559882:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9a00/0x113b6add9f869a23 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee333 expref: 20 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.559906:0:21946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f869a2a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee333 expref: 19 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.559931:0:21946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f8dda0a5e00) 00010000:00010000:3.0:1789584146.559935:0:21946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789584146.559939:0:21946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8df4fe8e00, rc 0) 00000100:00100000:3.0:1789584146.560035:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+19:19088:x1876514228576896:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 459us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584146.560044:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 58 00000100:00100000:2.0:1789584146.566952:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584146.567518:0:23258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228577024 00000100:00100000:0.0:1789584146.567534:0:23258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228577024 00000100:00100000:0.0:1789584146.567624:0:23258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:0.0:1789584146.567637:0:23258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8ded39f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:319b0417-2da6-48eb-878f-de6e4d622177+6:2400:x1876514228577024:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789584146.567664:0:23258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789584146.567693:0:23258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005edf17b3/0x113b6add9f869a31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee33a expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789584146.567732:0:23258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaae312, blocks: 0x1 00010000:00010000:0.0:1789584146.567763:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=799s v=(0 0) 00010000:00010000:0.0:1789584146.567768:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584146.567779:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005edf17b3/0x113b6add9f869a31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee33a expref: 7 pid: 23258 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.567803:0:23258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005edf17b3/0x113b6add9f869a31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee33a expref: 7 pid: 23258 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.567848:0:23258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8defc5fc00, rc 0) 00000100:00100000:0.0:1789584146.567923:0:23258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8ded39f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:319b0417-2da6-48eb-878f-de6e4d622177+7:2400:x1876514228577024:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 287us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584146.567931:0:23258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:2.0:1789584146.575875:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584146.576012:0:24708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228577280 00000100:00100000:1.0:1789584146.576027:0:24708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228577280 00000100:00100000:1.0:1789584146.576151:0:24708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:1.0:1789584146.576165:0:24708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+19:19088:x1876514228577280:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789584146.576756:0:24708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+19:19088:x1876514228577280:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 591us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584146.576767:0:24708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:2.0:1789584146.583856:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584146.583963:0:21946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228577408 00000100:00100000:3.0:1789584146.583988:0:21946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228577408 00000100:00100000:3.0:1789584146.584076:0:21946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 60 00000100:00100000:3.0:1789584146.584090:0:21946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+19:19088:x1876514228577408:12345-192.168.204.11@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789584146.633801:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901909 is committed 00000004:00080000:1.0:1789584146.633822:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789584146.633853:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00010000:00010000:2.0:1789584146.633931:0:3440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f869a15 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.633947:0:3440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f869a15 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.633957:0:3440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f869a15 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.633965:0:3440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5e000 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:2.0:1789584146.633981:0:3440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f869a15 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.633991:0:3440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f869a15 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.634012:0:3440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f8dda0a5e00) 00010000:00010000:2.0:1789584146.634016:0:3440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789584146.634114:0:3440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f869a15 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.634121:0:3440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5e000/0x113b6add9f869a15 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584146.634637:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253864704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789584146.634737:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584146.634889:0:23759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253864704 00000100:00100000:3.0:1789584146.634899:0:23759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253864704 00000100:00100000:3.0:1789584146.634979:0:23759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789584146.634991:0:23759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253864704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789584146.635598:0:23759:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789584146.635603:0:23759:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789584146.635606:0:23759:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789584146.635608:0:23759:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789584146 -> 1789584146 00002000:00010000:3.0:1789584146.635611:0:23759:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789584146.635717:0:23759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3455:x1876514253864704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 727us (979us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1789584146.635727:0:23759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789584146.635944:0:21946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:319b0417-2da6-48eb-878f-de6e4d622177+14:19088:x1876514228577408:12345-192.168.204.11@tcp:44:lhsmtool_posix.0 Request processed in 51853us (52101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584146.635956:0:21946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 60 00000100:00100000:1.0:1789584146.639413:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584146.642353:0:24713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228577536 00000100:00100000:3.0:1789584146.642376:0:24713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228577536 00000100:00100000:3.0:1789584146.642485:0:24713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:3.0:1789584146.642516:0:24713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:319b0417-2da6-48eb-878f-de6e4d622177+7:2400:x1876514228577536:12345-192.168.204.11@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789584146.642689:0:24713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:319b0417-2da6-48eb-878f-de6e4d622177+7:2400:x1876514228577536:12345-192.168.204.11@tcp:16:lhsmtool_posix.0 Request processed in 176us (3289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584146.642698:0:24713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 24 00000004:00080000:2.0:1789584146.645918:0:3455:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f8dfd729500/2, rc 0, transno 12884901892 00000100:00100000:2.0:1789584146.645943:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253864704:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789584146.646125:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584146.646205:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228577792 00000100:00100000:2.0:1789584146.646217:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228577792 00000100:00100000:2.0:1789584146.646279:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 61 00000100:00100000:2.0:1789584146.646288:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+14:19088:x1876514228577792:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789584146.646372:0:21947:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789584146.646410:0:21947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe8e00/0x113b6add9f869a2a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee333 expref: 14 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.646449:0:21947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f8dda0a5e00) 00010000:00010000:2.0:1789584146.646457:0:21947:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789584146.646499:0:21947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f869a38 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.646516:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f869a38 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.646527:0:21947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f869a38 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789584146.646799:0:21947:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cde4cec2 reply state 00000000f7cd4281 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f869a38 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.646835:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60a00/0x113b6add9f869a38 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.646842:0:21947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f8dda0a5e00) 00010000:00010000:2.0:1789584146.646845:0:21947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789584146.646848:0:21947:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789584146.647697:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+15:19088:x1876514228577792:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 1400us (1567us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1789584146.647708:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 61 00000100:00100000:3.0:1789584146.650688:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584146.650817:0:23258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228577920 00000100:00100000:1.0:1789584146.650832:0:23258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228577920 00000100:00100000:1.0:1789584146.650913:0:23258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:1.0:1789584146.650926:0:23258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:319b0417-2da6-48eb-878f-de6e4d622177+7:19088:x1876514228577920:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789584146.650953:0:23258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789584146.650987:0:23258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099de1813/0x113b6add9f869a3f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x85fdf7a6a92ee341 expref: -99 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.651122:0:23258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005edf17b3/0x113b6add9f869a31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee33a expref: 8 pid: 23258 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.651134:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584146.651140:0:23258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584146.651146:0:23258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099de1813/0x113b6add9f869a3f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee341 expref: 8 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.651313:0:23258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005edf17b3/0x113b6add9f869a31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee33a expref: 8 pid: 23258 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.651511:0:23258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005edf17b3/0x113b6add9f869a31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee33a expref: 8 pid: 23258 timeout: 899 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584146.651530:0:23258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:23258:1876514253864832:192.168.204.11@tcp:104: 00000100:00100000:1.0:1789584146.651638:0:23258:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dd86f9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789584146.666853:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584146.667637:0:23258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:23258:1876514253864832:192.168.204.11@tcp:104: 00010000:00010000:0.0:1789584146.667691:0:23258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099de1813/0x113b6add9f869a3f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee341 expref: 8 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.667725:0:23258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8ded95c200, rc 0) 00000100:00100000:0.0:1789584146.667826:0:23258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:319b0417-2da6-48eb-878f-de6e4d622177+8:19088:x1876514228577920:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 16902us (17152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584146.667838:0:23258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:3.0:1789584146.669565:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228578048 00000100:00100000:3.0:1789584146.669585:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228578048 00010000:00010000:3.0:1789584146.669648:0:21932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005edf17b3/0x113b6add9f869a31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee33a expref: 8 pid: 23258 timeout: 899 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584146.669755:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:3.0:1789584146.669767:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:319b0417-2da6-48eb-878f-de6e4d622177+8:2400:x1876514228578048:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789584146.669786:0:21932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789584146.669820:0:21932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005edf17b3/0x113b6add9f869a31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee33a expref: 8 pid: 23258 timeout: 899 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.669838:0:21932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005edf17b3/0x113b6add9f869a31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee33a expref: 8 pid: 23258 timeout: 899 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.669868:0:21932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005edf17b3/0x113b6add9f869a31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee33a expref: 8 pid: 23258 timeout: 899 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.669889:0:21932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584146.669894:0:21932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584146.669922:0:21932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099de1813/0x113b6add9f869a3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee341 expref: 7 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.669932:0:21932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099de1813/0x113b6add9f869a3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee341 expref: 7 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.669998:0:21932:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000099de1813/0x113b6add9f869a3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee341 expref: 7 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584146.670016:0:21932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfd729c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:21932:1876514253864960:192.168.204.11@tcp:105: 00000100:00100000:3.0:1789584146.670141:0:21932:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc7cebcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789584146.674159:0:21932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfd729c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:21932:1876514253864960:192.168.204.11@tcp:105: 00010000:00010000:3.0:1789584146.674230:0:21932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789584146.674302:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:319b0417-2da6-48eb-878f-de6e4d622177+7:2400:x1876514228578048:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 4536us (7464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584146.674317:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:2.0:1789584146.674674:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584146.675892:0:23255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228578176 00000100:00100000:0.0:1789584146.675909:0:23255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228578176 00000100:00100000:0.0:1789584146.676014:0:23255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:0.0:1789584146.676034:0:23255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:319b0417-2da6-48eb-878f-de6e4d622177+7:2399:x1876514228578176:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789584146.676907:0:23255:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789584146.676914:0:23255:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789584145 00002000:00010000:0.0:1789584146.676917:0:23255:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789584144 00002000:00010000:0.0:1789584146.676919:0:23255:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789584146 -> 1789584145 00002000:00010000:0.0:1789584146.676942:0:23255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789584146.677107:0:23255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:319b0417-2da6-48eb-878f-de6e4d622177+8:2399:x1876514228578176:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 Request processed in 1079us (3091us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1789584146.677120:0:23255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:0.0:1789584146.683312:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584146.683486:0:24713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228578304 00000100:00100000:3.0:1789584146.683501:0:24713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228578304 00000100:00100000:2.0:1789584146.683649:0:24713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:2.0:1789584146.683662:0:24713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:319b0417-2da6-48eb-878f-de6e4d622177+8:2402:x1876514228578304:12345-192.168.204.11@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789584146.683794:0:24713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a730dc4a/0x113b6add9f869a46 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.683821:0:24713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099de1813/0x113b6add9f869a3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee341 expref: 8 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.683832:0:24713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789584146.683838:0:24713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789584146.683844:0:24713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a730dc4a/0x113b6add9f869a46 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.683892:0:24713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099de1813/0x113b6add9f869a3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee341 expref: 8 pid: 23258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584146.683936:0:24713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099de1813/0x113b6add9f869a3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee341 expref: 8 pid: 23258 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584146.683956:0:24713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfc9f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24713:1876514253865088:192.168.204.11@tcp:104: 00000100:00100000:2.0:1789584146.684088:0:24713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc7ed1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789584146.688421:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584146.688606:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228578432 00000100:00100000:3.0:1789584146.688620:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228578432 00010000:00010000:3.0:1789584146.688676:0:21930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099de1813/0x113b6add9f869a3f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee341 expref: 9 pid: 23258 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584146.688773:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:3.0:1789584146.688785:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:319b0417-2da6-48eb-878f-de6e4d622177+9:2400:x1876514228578432:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789584146.688806:0:21930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789584146.688857:0:21930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000099de1813/0x113b6add9f869a3f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee341 expref: 9 pid: 23258 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.688875:0:21930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099de1813/0x113b6add9f869a3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee341 expref: 9 pid: 23258 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.688913:0:21930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1789584146.688919:0:21930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1789584146.688928:0:21930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a730dc4a/0x113b6add9f869a46 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.688942:0:21930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a730dc4a/0x113b6add9f869a46 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.688981:0:21930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789584146.689085:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:319b0417-2da6-48eb-878f-de6e4d622177+9:2400:x1876514228578432:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 302us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584146.689095:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 20 00010000:00010000:0.0:1789584146.689612:0:24713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099de1813/0x113b6add9f869a3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee341 expref: 8 pid: 23258 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584146.689633:0:24713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfc9f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24713:1876514253865088:192.168.204.11@tcp:104: 00010000:00010000:0.0:1789584146.689671:0:24713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a730dc4a/0x113b6add9f869a46 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.689762:0:24713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a730dc4a/0x113b6add9f869a46 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.689772:0:24713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a730dc4a/0x113b6add9f869a46 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.689807:0:24713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a730dc4a/0x113b6add9f869a46 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.689827:0:24713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a730dc4a/0x113b6add9f869a46 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.689836:0:24713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a730dc4a/0x113b6add9f869a46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.689844:0:24713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c60400 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:1.0:1789584146.689849:0:24713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a730dc4a/0x113b6add9f869a46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.689858:0:24713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a730dc4a/0x113b6add9f869a46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.689874:0:24713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a730dc4a/0x113b6add9f869a46 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.689881:0:24713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a730dc4a/0x113b6add9f869a46 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584146.689968:0:24713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:319b0417-2da6-48eb-878f-de6e4d622177+7:2402:x1876514228578304:12345-192.168.204.11@tcp:1:lhsmtool_posix.0 Request processed in 6309us (6671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584146.689988:0:24713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:2.0:1789584146.699517:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584146.699645:0:21945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228578688 00000100:00100000:0.0:1789584146.699659:0:21945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228578688 00000100:00100000:0.0:1789584146.699777:0:21945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 62 00000100:00100000:0.0:1789584146.699791:0:21945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+15:19088:x1876514228578688:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789584146.699902:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f000/0x113b6add9f869a4d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.699924:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f000/0x113b6add9f869a4d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.699943:0:21945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f000/0x113b6add9f869a4d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.700366:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f800/0x113b6add9f869a54 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.700396:0:21945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869a1c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee32c expref: 16 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.700406:0:21945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f800/0x113b6add9f869a54 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.700655:0:21945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869a1c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee32c expref: 16 pid: 21945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.700676:0:21945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869a1c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee32c expref: 16 pid: 21945 timeout: 900 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584146.700696:0:21945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21945:1876514253865216:192.168.204.11@tcp:104: 00000100:00100000:0.0:1789584146.700882:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df7613300 going to sleep for 11 seconds 00000100:00100000:2.0:1789584146.704174:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584146.704342:0:21983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228578816 00000100:00100000:1.0:1789584146.704355:0:21983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228578816 00010000:00010000:1.0:1789584146.704414:0:21983:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869a1c lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee32c expref: 17 pid: 21945 timeout: 900 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584146.704485:0:21983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:1.0:1789584146.704498:0:21983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:319b0417-2da6-48eb-878f-de6e4d622177+17:2399:x1876514228578816:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789584146.704519:0:21983:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789584146.704527:0:21983:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869a1c lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee32c expref: 17 pid: 21945 timeout: 900 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.704544:0:21983:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869a1c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee32c expref: 17 pid: 21945 timeout: 900 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.704572:0:21983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f8dda0a5e00) 00010000:00010000:1.0:1789584146.704578:0:21983:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f800/0x113b6add9f869a54 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.704590:0:21983:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f800/0x113b6add9f869a54 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.704600:0:21983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f800/0x113b6add9f869a54 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.704626:0:21983:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789584146.704697:0:21983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:319b0417-2da6-48eb-878f-de6e4d622177+17:2399:x1876514228578816:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 201us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584146.704705:0:21983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 21 00010000:00010000:0.0:1789584146.705238:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c61800/0x113b6add9f869a1c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee32c expref: 16 pid: 21945 timeout: 900 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584146.705260:0:21945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21945:1876514253865216:192.168.204.11@tcp:104: 00010000:00010000:0.0:1789584146.705297:0:21945:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f800/0x113b6add9f869a54 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.705308:0:21945:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f800/0x113b6add9f869a54 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.705314:0:21945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f800/0x113b6add9f869a54 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789584146.705556:0:21945:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1789584146.705748:0:21945:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1789584146.705797:0:21945:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1789584146.705904:0:21945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df4f34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:21945:1876514253865344:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789584146.706009:0:21945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584146.706136:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8df6ec1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789584146.706244:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253865344 00000100:00100000:2.0:1789584146.706252:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253865344 00000100:00100000:2.0:1789584146.706311:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789584146.706323:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:21945:x1876514253865344:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789584146.706420:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:21945:x1876514253865344:12345-0@lo:1000:mdt00_000.0 Request processed in 99us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584146.706429:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789584146.706616:0:21945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df4f34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:21945:1876514253865344:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789584146.707918:0:21945:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1789584146.708447:0:21945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:21945:1876514253865472:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789584146.708530:0:21945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789584146.708641:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc6112000 going to sleep for 11 seconds 00000100:00100000:3.0:1789584146.708693:0:22867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253865472 00000100:00100000:3.0:1789584146.708702:0:22867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253865472 00000100:00100000:3.0:1789584146.708804:0:22867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789584146.708816:0:22867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:21945:x1876514253865472:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789584146.709095:0:22867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:21945:x1876514253865472:12345-0@lo:1000:mdt00_000.0 Request processed in 280us (564us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1789584146.709103:0:22867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789584146.709237:0:21945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:21945:1876514253865472:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789584146.709289:0:21945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f800/0x113b6add9f869a54 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.709313:0:21945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f800/0x113b6add9f869a54 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.709323:0:21945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f800/0x113b6add9f869a54 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.709330:0:21945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5f800 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:1.0:1789584146.709336:0:21945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f800/0x113b6add9f869a54 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.709346:0:21945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f800/0x113b6add9f869a54 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.709368:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f8dda0a5e00) 00010000:00010000:1.0:1789584146.709371:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789584146.709378:0:21945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f800/0x113b6add9f869a54 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.709386:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f800/0x113b6add9f869a54 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.709429:0:21945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f8699ac lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.709437:0:21945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f8699ac lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.709443:0:21945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f8699ac lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.709458:0:21945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c60e00 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:1.0:1789584146.709462:0:21945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f8699ac lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.709469:0:21945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f8699ac lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.709479:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:1.0:1789584146.709481:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789584146.709490:0:21945:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f8699b3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee310 expref: 19 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.709505:0:21945:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f8699b3 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee310 expref: 19 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.709516:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f8699b3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee310 expref: 19 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.709588:0:21945:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95d000/0x113b6add9f8699b3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x85fdf7a6a92ee310 expref: 19 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584146.709604:0:21945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8df6f8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21945:1876514253865600:192.168.204.11@tcp:105: 00000100:00100000:1.0:1789584146.709709:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f8dc61126c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789584146.716651:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584146.716791:0:21945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8df6f8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21945:1876514253865600:192.168.204.11@tcp:105: 00010000:00010000:1.0:1789584146.716833:0:21945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f8699ac lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.716870:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8dc4c60e00/0x113b6add9f8699ac lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.716914:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95ce00/0x113b6add9f869a5b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.716932:0:21945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95ce00/0x113b6add9f869a5b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.716946:0:21945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95ce00/0x113b6add9f869a5b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.716958:0:21945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95ce00/0x113b6add9f869a5b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.716965:0:21945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95ce00/0x113b6add9f869a5b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.716983:0:21945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95ce00/0x113b6add9f869a5b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.716990:0:21945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95ce00 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:1.0:1789584146.716994:0:21945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95ce00/0x113b6add9f869a5b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.717003:0:21945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95ce00/0x113b6add9f869a5b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.717015:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:1.0:1789584146.717027:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789584146.717033:0:21945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95ce00/0x113b6add9f869a5b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.717046:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8ded95ce00/0x113b6add9f869a5b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.717059:0:21945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f000/0x113b6add9f869a4d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.717065:0:21945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f000/0x113b6add9f869a4d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.717071:0:21945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f000/0x113b6add9f869a4d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.717077:0:21945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5f000 already unused, calling callback (ffffffffc20164f0) 00010000:00010000:1.0:1789584146.717081:0:21945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f000/0x113b6add9f869a4d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.717086:0:21945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f000/0x113b6add9f869a4d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.717094:0:21945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f8de7836600) 00010000:00010000:1.0:1789584146.717096:0:21945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789584146.717099:0:21945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f000/0x113b6add9f869a4d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584146.717105:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8defc5f000/0x113b6add9f869a4d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21945 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789584146.717990:0:21981:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789584146.717999:0:21981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789584146.718047:0:21981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789584146.718054:0:21981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1789584146.718165:0:21945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:319b0417-2da6-48eb-878f-de6e4d622177+19:19088:x1876514228578688:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 18370us (18655us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1789584146.718179:0:21945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 62 00000020:00080000:1.0:1789584146.718250:0:21945:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789584146.718425:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228578944 00000100:00100000:3.0:1789584146.718436:0:21948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228578944 00000100:00100000:3.0:1789584146.718503:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:3.0:1789584146.718513:0:21948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc73e9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:319b0417-2da6-48eb-878f-de6e4d622177+19:19087:x1876514228578944:12345-192.168.204.11@tcp:49:dd.0 00000100:00100000:3.0:1789584146.718673:0:21948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc73e9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:319b0417-2da6-48eb-878f-de6e4d622177+19:19087:x1876514228578944:12345-192.168.204.11@tcp:49:dd.0 Request processed in 162us (2039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584146.718681:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:1.0:1789584146.725912:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584146.726038:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228579200 00000100:00100000:3.0:1789584146.726051:0:21948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228579200 00000100:00100000:3.0:1789584146.726126:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:3.0:1789584146.726137:0:21948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:319b0417-2da6-48eb-878f-de6e4d622177+19:19088:x1876514228579200:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789584146.727088:0:21948:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789584146.727240:0:21948:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1789584146.727300:0:21948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9a00/0x113b6add9f869a62 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.727323:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9a00/0x113b6add9f869a62 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 21948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.727338:0:21948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9a00/0x113b6add9f869a62 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 21948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.727349:0:21948:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9a00/0x113b6add9f869a62 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 21948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.727355:0:21948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9a00/0x113b6add9f869a62 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 21948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.727362:0:21948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9a00/0x113b6add9f869a62 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 21948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.727383:0:21948:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789584146.729327:0:21933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789584146.729345:0:21933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9a00/0x113b6add9f869a62 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 21948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.729358:0:21933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe9a00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:0.0:1789584146.729363:0:21933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9a00/0x113b6add9f869a62 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 21948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.729375:0:21933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9a00/0x113b6add9f869a62 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 21948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.729398:0:21933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f8dda0a5e00) 00010000:00010000:0.0:1789584146.729401:0:21933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789584146.729408:0:21933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9a00/0x113b6add9f869a62 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 21948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.729415:0:21933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8df4fe9a00/0x113b6add9f869a62 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 21948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584146.729451:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584146.729453:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584146.729455:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584146.732927:0:21948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:319b0417-2da6-48eb-878f-de6e4d622177+21:19088:x1876514228579200:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 6769us (7011us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1789584146.732948:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000020:00080000:3.0:1789584146.732959:0:21948:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789584146.984499:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584146.985268:0:23261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228579328 00000100:00100000:3.0:1789584146.985282:0:23261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228579328 00000100:00100000:3.0:1789584146.986264:0:23261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:3.0:1789584146.986279:0:23261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:319b0417-2da6-48eb-878f-de6e4d622177+7:2402:x1876514228579328:12345-192.168.204.11@tcp:4:dd.0 00002000:00010000:3.0:1789584146.986902:0:23261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aaae311, atime: 0x6aaae310, ctime: 0x6aaae311, blocks: 0x1 00010000:00010000:3.0:1789584146.986918:0:23261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.986941:0:23261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1789584146.986947:0:23261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584146.986954:0:23261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584146.986983:0:23261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584146.995940:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1789584146.996858:0:23263:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789584146.996876:0:23263:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789584146.997144:0:23263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228579456 00000100:00100000:1.0:1789584146.997159:0:23263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228579456 00000100:00100000:1.0:1789584147.016276:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:1.0:1789584147.016305:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:319b0417-2da6-48eb-878f-de6e4d622177+9:2399:x1876514228579456:12345-192.168.204.11@tcp:4:dd.0 00010000:00010000:1.0:1789584147.016380:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007fcec0/0x113b6add9f869a70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584147.016406:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584147.016411:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789584147.016419:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000007fcec0/0x113b6add9f869a70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584147.016655:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000007fcec0/0x113b6add9f869a70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584147.024309:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584147.024515:0:23263:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789584147.024528:0:23263:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1789584147.025206:0:23263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228579584 00000100:00100000:2.0:1789584147.025219:0:23263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228579584 00000100:00100000:2.0:1789584147.031111:0:24716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:2.0:1789584147.031144:0:24716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfc9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:319b0417-2da6-48eb-878f-de6e4d622177+11:2401:x1876514228579584:12345-192.168.204.11@tcp:4:dd.0 00010000:00010000:0.0:1789584147.031508:0:24716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f869a77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584147.031548:0:24716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584147.031553:0:24716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789584147.031562:0:24716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f869a77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789584147.031581:0:24716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f869a77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.099690:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789584147.219544:0:9074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901897 is committed 00000001:00080000:3.0:1789584147.219592:0:9074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1789584147.219835:0:24715:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1789584147.219841:0:24715:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1789584145 -> 1789584146 00002000:00010000:2.0:1789584147.219844:0:24715:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:2.0:1789584147.219865:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007fcec0/0x113b6add9f869a70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.219882:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000007fcec0/0x113b6add9f869a70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.219892:0:24715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000007fcec0/0x113b6add9f869a70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.219901:0:24715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8ded95ce00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584147.219908:0:24715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000007fcec0/0x113b6add9f869a70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.219919:0:24715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000007fcec0/0x113b6add9f869a70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.219944:0:24715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000007fcec0/0x113b6add9f869a70 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.219952:0:24715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000007fcec0/0x113b6add9f869a70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584147.220122:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:319b0417-2da6-48eb-878f-de6e4d622177+9:2399:x1876514228579456:12345-192.168.204.11@tcp:4:dd.0 Request processed in 203823us (224192us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1789584147.220133:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 1 00010000:00010000:2.0:1789584147.220238:0:24716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f869a77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.220248:0:24716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f869a77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.220256:0:24716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f869a77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.220263:0:24716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8defc5ec00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584147.220267:0:24716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f869a77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.220275:0:24716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f869a77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.220286:0:24716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f869a77 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.220294:0:24716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d7549fe/0x113b6add9f869a77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584147.220345:0:24716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfc9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:319b0417-2da6-48eb-878f-de6e4d622177+7:2401:x1876514228579584:12345-192.168.204.11@tcp:4:dd.0 Request processed in 189214us (196051us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1789584147.220353:0:24716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 2 00010000:00010000:3.0:1789584147.221926:0:23261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.221946:0:23261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.221986:0:23261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.221994:0:23261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8200 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584147.221999:0:23261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.222009:0:23261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.222030:0:23261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a69 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.222038:0:23261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584147.222168:0:23261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:319b0417-2da6-48eb-878f-de6e4d622177+5:2402:x1876514228579328:12345-192.168.204.11@tcp:4:dd.0 Request processed in 235888us (237850us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1789584147.222179:0:23261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:3.0:1789584147.229612:0:3448:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584147.229709:0:23263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228579712 00000100:00100000:2.0:1789584147.229723:0:23263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228579712 00000100:00100000:2.0:1789584147.229828:0:23263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:2.0:1789584147.229842:0:23263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:319b0417-2da6-48eb-878f-de6e4d622177+5:2400:x1876514228579712:12345-192.168.204.11@tcp:4:dd.0 00002000:00010000:2.0:1789584147.229913:0:23263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 3145728, mtime: 0x6aaae312, atime: 0x6aaae310, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1789584147.229925:0:23263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e794b3f1/0x113b6add9f869a7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.229946:0:23263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=800s v=(0 0) 00010000:00010000:2.0:1789584147.229951:0:23263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789584147.229968:0:23263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e794b3f1/0x113b6add9f869a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.229987:0:23263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e794b3f1/0x113b6add9f869a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584147.241084:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584147.241746:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228579840 00000100:00100000:2.0:1789584147.241763:0:24715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228579840 00000100:00100000:2.0:1789584147.241866:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:2.0:1789584147.241880:0:24715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df6f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:319b0417-2da6-48eb-878f-de6e4d622177+7:2399:x1876514228579840:12345-192.168.204.11@tcp:4:dd.0 00010000:00010000:2.0:1789584147.241928:0:24715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9307bb6/0x113b6add9f869a85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.241977:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789584147.241983:0:24715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789584147.241991:0:24715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9307bb6/0x113b6add9f869a85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.242009:0:24715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9307bb6/0x113b6add9f869a85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584147.250051:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584147.250596:0:23261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228579968 00000100:00100000:3.0:1789584147.250611:0:23261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228579968 00000100:00100000:3.0:1789584147.250706:0:23261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:3.0:1789584147.250720:0:23261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:319b0417-2da6-48eb-878f-de6e4d622177+9:2399:x1876514228579968:12345-192.168.204.11@tcp:4:dd.0 00010000:00010000:3.0:1789584147.250767:0:23261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.250807:0:23261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584147.250812:0:23261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584147.250822:0:23261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.250840:0:23261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789584147.258999:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1789584147.259048:0:3447:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584147.259141:0:23262:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789584147.259154:0:23262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:2.0:1789584147.259392:0:24716:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1789584147.259405:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228580096 00000100:00100000:2.0:1789584147.259418:0:24716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228580096 00000100:00100000:2.0:1789584147.259566:0:24716:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1789584147.259572:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228580224 00000100:00100000:2.0:1789584147.259576:0:24716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228580224 00000100:00100000:3.0:1789584147.263951:0:24719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:3.0:1789584147.263988:0:24719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8df4f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:319b0417-2da6-48eb-878f-de6e4d622177+14:2399:x1876514228580096:12345-192.168.204.11@tcp:4:dd.0 00010000:00010000:3.0:1789584147.264047:0:24719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f869a93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.264072:0:24719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584147.264077:0:24719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584147.264084:0:24719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f869a93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.264102:0:24719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f869a93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789584147.329537:0:9074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901898 is committed 00002000:00010000:3.0:1789584147.329632:0:23263:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:3.0:1789584147.329643:0:23263:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1789584146 -> 1789584147 00002000:00010000:3.0:1789584147.329647:0:23263:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 0 -> 1789584147 00002000:00010000:3.0:1789584147.329667:0:23263:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1789584147.329684:0:23263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e794b3f1/0x113b6add9f869a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.329699:0:23263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e794b3f1/0x113b6add9f869a7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.329710:0:23263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e794b3f1/0x113b6add9f869a7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.329718:0:23263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c61c00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584147.329724:0:23263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e794b3f1/0x113b6add9f869a7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.329734:0:23263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e794b3f1/0x113b6add9f869a7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.329756:0:23263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e794b3f1/0x113b6add9f869a7e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.329766:0:23263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e794b3f1/0x113b6add9f869a7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584147.329876:0:23263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:319b0417-2da6-48eb-878f-de6e4d622177+18:2400:x1876514228579712:12345-192.168.204.11@tcp:4:dd.0 Request processed in 100032us (100276us total) trans 12884901898 rc 0/0 00000100:00100000:3.0:1789584147.329889:0:23263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:3.0:1789584147.329936:0:23263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:3.0:1789584147.330115:0:23263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:319b0417-2da6-48eb-878f-de6e4d622177+17:2400:x1876514228580224:12345-192.168.204.11@tcp:4:dd.0 00010000:00010000:3.0:1789584147.331776:0:23263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f869a9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.331796:0:23263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584147.331801:0:23263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789584147.331807:0:23263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f869a9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.331820:0:23263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f869a9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789584147.402818:0:9074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901899 is committed 00000001:00080000:2.0:1789584147.402859:0:9074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901900 is committed 00000001:00080000:2.0:1789584147.402881:0:9074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901901 is committed 00002000:00010000:2.0:1789584147.403129:0:23261:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1789584147.403135:0:23261:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:2.0:1789584147.403157:0:23261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.403173:0:23261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.403184:0:23261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.403239:0:23261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8200 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:2.0:1789584147.403245:0:23261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.403256:0:23261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a8c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.403282:0:23261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a8c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789584147.403291:0:23261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058163902/0x113b6add9f869a8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789584147.403833:0:23261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:319b0417-2da6-48eb-878f-de6e4d622177+13:2399:x1876514228579968:12345-192.168.204.11@tcp:4:dd.0 Request processed in 153109us (153789us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1789584147.403846:0:23261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 5 00010000:00010000:1.0:1789584147.404228:0:24715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9307bb6/0x113b6add9f869a85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584147.404240:0:24715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9307bb6/0x113b6add9f869a85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584147.404248:0:24715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9307bb6/0x113b6add9f869a85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584147.404270:0:24715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8dc4c61800 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:1.0:1789584147.404275:0:24715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9307bb6/0x113b6add9f869a85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584147.404283:0:24715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9307bb6/0x113b6add9f869a85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584147.404301:0:24715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9307bb6/0x113b6add9f869a85 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789584147.404309:0:24715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9307bb6/0x113b6add9f869a85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789584147.404365:0:24715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df6f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:319b0417-2da6-48eb-878f-de6e4d622177+11:2399:x1876514228579840:12345-192.168.204.11@tcp:4:dd.0 Request processed in 162489us (163298us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1789584147.404374:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 4 00010000:00010000:3.0:1789584147.413589:0:24719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f869a93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.413616:0:24719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f869a93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.413628:0:24719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f869a93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.413636:0:24719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe9a00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584147.413642:0:24719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f869a93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.413652:0:24719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f869a93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.413714:0:24719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f869a93 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.413722:0:24719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048252e2b/0x113b6add9f869a93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584147.413868:0:24719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8df4f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:319b0417-2da6-48eb-878f-de6e4d622177+9:2399:x1876514228580096:12345-192.168.204.11@tcp:4:dd.0 Request processed in 149883us (154876us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1789584147.413880:0:24719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 6 00000001:00080000:1.0:1789584147.455965:0:9074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901902 is committed 00002000:00010000:3.0:1789584147.456543:0:23263:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1789584147.456563:0:23263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f869a9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.456580:0:23263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f869a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.456591:0:23263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f869a9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.456598:0:23263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8df4fe8a00 already unused, calling callback (ffffffffc15b98b0) 00010000:00010000:3.0:1789584147.456604:0:23263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f869a9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.456615:0:23263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f869a9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.456660:0:23263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f869a9a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789584147.456668:0:23263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ef26152/0x113b6add9f869a9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789584147.456845:0:23263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:319b0417-2da6-48eb-878f-de6e4d622177+5:2400:x1876514228580224:12345-192.168.204.11@tcp:4:dd.0 Request processed in 126884us (197789us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1789584147.456856:0:23263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000040:00080000:2.0:1789584147.740075:0:21981:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789584147.740090:0:21981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789584147.740133:0:21981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789584147.740145:0:21981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1789584148.124126:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789584149.153408:0:21933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789584149.387605:0:24757:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1789584149.653787:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584149.653834:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584149.653861:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584149.654116:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584149.654147:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584149.654202:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584149.654228:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584149.654247:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1789584149.654333:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228580608 00000100:00100000:2.0:1789584149.654347:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228580608 00000100:00100000:3.0:1789584149.662151:0:3449:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1789584149.662225:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228580352 00000100:00100000:3.0:1789584149.662239:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228580352 00000100:00100000:3.0:1789584149.662309:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 166 00000100:00100000:3.0:1789584149.662322:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dc4ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+13:2399:x1876514228580352:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789584149.662424:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dc4ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98df0fde-e9b8-4032-b372-dfd508e8b711+13:2399:x1876514228580352:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 104us (8654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584149.662432:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 166 00000100:00100000:3.0:1789584149.662487:0:23257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228580864 00000100:00100000:3.0:1789584149.662492:0:23257:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228580864 00000100:00100000:3.0:1789584149.662528:0:23257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228581376 00000100:00100000:3.0:1789584149.662532:0:23257:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228581376 00000100:00100000:3.0:1789584149.662553:0:23257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228580736 00000100:00100000:3.0:1789584149.662556:0:23257:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228580736 00000100:00100000:3.0:1789584149.662568:0:23257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228581248 00000100:00100000:3.0:1789584149.662571:0:23257:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228581248 00000100:00100000:3.0:1789584149.662593:0:23257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:3.0:1789584149.662599:0:23257:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:319b0417-2da6-48eb-878f-de6e4d622177+5:2399:x1876514228580864:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789584149.662634:0:23257:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:319b0417-2da6-48eb-878f-de6e4d622177+5:2399:x1876514228580864:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 35us (8772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584149.662640:0:23257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:3.0:1789584149.663369:0:23257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:3.0:1789584149.663388:0:23257:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2408ec3-193f-4ced-b3de-620548852bdb+5:2399:x1876514228581376:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789584149.663519:0:23257:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2408ec3-193f-4ced-b3de-620548852bdb+5:2399:x1876514228581376:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 135us (9369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584149.663528:0:23257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:3.0:1789584149.663544:0:23257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:3.0:1789584149.663551:0:23257:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc53bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:319b0417-2da6-48eb-878f-de6e4d622177+5:2399:x1876514228580736:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1789584149.663579:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228581120 00000100:00100000:3.0:1789584149.663581:0:23257:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc53bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:319b0417-2da6-48eb-878f-de6e4d622177+5:2399:x1876514228580736:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 31us (9352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789584149.663588:0:24708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228580480 00000100:00100000:3.0:1789584149.663589:0:23257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:2.0:1789584149.663589:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228581120 00000100:00100000:1.0:1789584149.663597:0:24708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228580480 00000100:00100000:3.0:1789584149.663603:0:23257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:3.0:1789584149.663611:0:23257:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc53bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2408ec3-193f-4ced-b3de-620548852bdb+5:2399:x1876514228581248:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1789584149.663638:0:23257:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc53bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2408ec3-193f-4ced-b3de-620548852bdb+5:2399:x1876514228581248:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 29us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584149.663641:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514228580992 00000100:00100000:2.0:1789584149.663646:0:21947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514228580992 00000100:00100000:3.0:1789584149.663656:0:23257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:1.0:1789584149.663662:0:24708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 55 00000100:00100000:1.0:1789584149.663686:0:24708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+5:2399:x1876514228580608:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1789584149.663733:0:24708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:319b0417-2da6-48eb-878f-de6e4d622177+5:2399:x1876514228580608:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 62us (9897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584149.663783:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 56 00000100:00100000:2.0:1789584149.663800:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfd72a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2408ec3-193f-4ced-b3de-620548852bdb+5:2399:x1876514228581120:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1789584149.663833:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfd72a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2408ec3-193f-4ced-b3de-620548852bdb+5:2399:x1876514228581120:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 35us (9717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584149.663840:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 56 00000100:00100000:2.0:1789584149.663860:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 57 00000100:00100000:2.0:1789584149.663867:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc53bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+21:2399:x1876514228580480:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1789584149.663899:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc53bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:319b0417-2da6-48eb-878f-de6e4d622177+21:2399:x1876514228580480:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 33us (9712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584149.663905:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 57 00000100:00100000:2.0:1789584149.663931:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 58 00000100:00100000:2.0:1789584149.663938:0:21947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc53bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2408ec3-193f-4ced-b3de-620548852bdb+6:2399:x1876514228580992:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1789584149.663965:0:21947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc53bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2408ec3-193f-4ced-b3de-620548852bdb+6:2399:x1876514228580992:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 28us (9716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584149.663970:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 58 00000100:00100000:1.0:1789584149.664482:0:24708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 55 00000100:00080000:1.0:1789584149.664519:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789584149.664526:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789584149.664531:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789584149.664535:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789584150.171521:0:21934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789584150.493921:0:3457:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789584150.493955:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8cc53bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253865728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789584150.494057:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789584150.494115:0:23260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253865728 00000100:00100000:3.0:1789584150.494125:0:23260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253865728 00000100:00100000:3.0:1789584150.494209:0:23260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789584150.494220:0:23260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc53bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253865728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789584150.494279:0:23260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789584150.494329:0:23260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc53bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3457:x1876514253865728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789584150.494337:0:23260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789584150.496099:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789584150.496229:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8cc53bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3457:1876514253865728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789584150.497014:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfc9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253865856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789584150.497104:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789584150.498834:0:23259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253865856 00000100:00100000:2.0:1789584150.498853:0:23259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253865856 00000100:00100000:2.0:1789584150.498960:0:23259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789584150.498969:0:21941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789584150.498973:0:23259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8cc53bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253865856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789584150.499009:0:23259:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789584150.499116:0:23259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8cc53bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3457:x1876514253865856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789584150.499125:0:23259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789584150.499295:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfc9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3457:1876514253865856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789584151.004840:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789584151.004873:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dfc9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253865984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789584151.004998:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584151.005406:0:3455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f8dee1aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253866112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789584151.005443:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789584151.005481:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253865984 00000100:00100000:0.0:1789584151.005491:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253865984 00000100:00100000:0.0:1789584151.006353:0:21951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514253866112 00000100:00100000:0.0:1789584151.006363:0:21951:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514253866112 00000100:00100000:0.0:1789584151.006396:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789584151.006407:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dfac2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253865984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789584151.006463:0:21951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789584151.006711:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dfac2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3455:x1876514253865984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 305us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584151.006720:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789584151.006743:0:21951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789584151.006750:0:21951:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8dee1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253866112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789584151.006789:0:21951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789584151.006825:0:21951:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8dee1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3455:x1876514253866112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789584151.006833:0:21951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789584151.006914:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dee1aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3455:1876514253866112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789584151.006935:0:3455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f8dfc9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3455:1876514253865984:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789584151.196043:0:24198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14482 lines, 14482 kept, 0 dropped, 0 bad.