00010000:00010000:3.0F:1785944231.134050:0:7273:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785944231.206090:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944231.206133:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944231.206163:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944231.206179:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944231.206198:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944231.206235:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880505600 00000100:00100000:3.0:1785944231.206243:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880505600 00000100:00100000:3.0:1785944231.206290:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880505728 00000100:00100000:3.0:1785944231.206293:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880505728 00000100:00100000:3.0:1785944231.206314:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 115 00000100:00100000:3.0:1785944231.206324:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+5:2406:x1872697880505600:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1785944231.206385:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+5:2406:x1872697880505600:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 62us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944231.206392:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 115 00000100:00100000:3.0:1785944231.206408:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 116 00000100:00100000:3.0:1785944231.206413:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+11:2406:x1872697880505728:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1785944231.206437:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+11:2406:x1872697880505728:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 24us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944231.206443:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 116 00000100:00100000:0.0F:1785944231.206541:0:9903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880505344 00000100:00100000:0.0:1785944231.206551:0:9903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880505344 00000100:00100000:0.0:1785944231.206585:0:9903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880505472 00000100:00100000:0.0:1785944231.206588:0:9903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880505472 00000100:00100000:0.0:1785944231.206607:0:9903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 280 00000100:00100000:0.0:1785944231.206614:0:9903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+8:2406:x1872697880505344:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1785944231.206655:0:9903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+8:2406:x1872697880505344:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 42us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944231.206662:0:9903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 280 00000100:00100000:0.0:1785944231.206674:0:9903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 281 00000100:00100000:0.0:1785944231.206680:0:9903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+11:2406:x1872697880505472:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1785944231.206699:0:9903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+11:2406:x1872697880505472:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 20us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944231.206705:0:9903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 281 00000100:00100000:1.0F:1785944231.206775:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880505216 00000100:00100000:1.0:1785944231.206784:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880505216 00000100:00100000:1.0:1785944231.206868:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 343 00000100:00100000:1.0:1785944231.206875:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:241f1677-b528-438b-8353-7b94a079ece4+10:2406:x1872697880505216:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1785944231.206900:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:241f1677-b528-438b-8353-7b94a079ece4+10:2406:x1872697880505216:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 26us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944231.206906:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 343 00000100:00080000:0.0:1785944231.211914:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1785944231.211924:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785944231.212025:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785944231.212030:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0F:1785944231.380978:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785944231.381004:0:3473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3473:1872697906825088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785944231.381067:0:3473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944231.381239:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfdeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3475:1872697906825216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785944231.381272:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944231.381388:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906825088 00000100:00100000:1.0:1785944231.381396:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906825088 00000100:00100000:1.0:1785944231.381445:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906825216 00000100:00100000:1.0:1785944231.381449:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906825216 00000100:00100000:1.0:1785944231.381472:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1785944231.381482:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3473:x1872697906825088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785944231.381522:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1785944231.381575:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3473:x1872697906825088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944231.381582:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1785944231.381598:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1785944231.381605:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1872697906825216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1785944231.381624:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1785944231.381670:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1872697906825216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944231.381677:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1785944231.381706:0:3475:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1785944231.381710:0:3475:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967301 00000020:00080000:1.0:1785944231.381716:0:3475:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff967ba7f5d900 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1785944231.381720:0:3475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff967a88aeae00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff967b98efd9c0 00000020:00080000:1.0:1785944231.381729:0:3475:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].1 00000020:00080000:1.0:1785944231.381732:0:3475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff967a88aead00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff967ba6d04800 00000020:00080000:1.0:1785944231.381734:0:3475:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].1 00000100:00100000:1.0:1785944231.381781:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfdeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3475:1872697906825216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785944231.381806:0:3473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3473:1872697906825088:0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1785944231.382322:0:6499:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1785944231.382421:0:6499:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1785944231.893995:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785944231.894016:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfdeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3475:1872697906825344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785944231.894078:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944231.894324:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785944231.894333:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfdeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906825472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785944231.894363:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944231.894397:0:9688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906825344 00000100:00100000:1.0:1785944231.894403:0:9688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906825344 00000100:00100000:1.0:1785944231.894446:0:9688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906825472 00000100:00100000:1.0:1785944231.894449:0:9688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906825472 00000100:00100000:1.0:1785944231.894463:0:9688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1785944231.894470:0:9688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfdebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1872697906825344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785944231.894500:0:9688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 50921472 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785944231.894555:0:9688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfdebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1872697906825344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944231.894561:0:9688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1785944231.894575:0:9688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1785944231.894580:0:9688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbd294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1872697906825472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1785944231.894588:0:9688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 50921472 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785944231.894638:0:9688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbd294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1872697906825472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944231.894657:0:9688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1785944231.894835:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfdeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906825472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785944231.894889:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfdeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3475:1872697906825344:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1785944231.895080:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785944231.895145:0:3473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3473:1872697906825984:0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.895175:0:3473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944231.895201:0:3473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3473:1872697906826496:0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.895220:0:3473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944231.895239:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1785944231.895245:0:3473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77517232-4860-4396-96b0-aef00b03546e:3473:1872697906825600:0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.895270:0:3473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944231.895291:0:3473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3473:1872697906826112:0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.895314:0:3473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944231.895340:0:3473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3473:1872697906826624:0@lo:400:kworker.0 00000100:00100000:3.0:1785944231.895350:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906826112 00000100:00100000:3.0:1785944231.895354:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906826112 00000100:00100000:2.0:1785944231.895360:0:3473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944231.895382:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1785944231.895382:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3476:1872697906825856:0@lo:400:kworker.0 00000100:00100000:3.0:1785944231.895389:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1872697906826112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.895404:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944231.895420:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3476:1872697906826368:0@lo:400:kworker.0 00000100:00100000:3.0:1785944231.895425:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1872697906826112:12345-0@lo:400:kworker.0 Request processed in 38us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944231.895431:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1785944231.895438:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944231.895450:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906825856 00000100:00100000:3.0:1785944231.895453:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906825856 00000100:00100000:2.0:1785944231.895453:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3476:1872697906826880:0@lo:400:kworker.0 00000100:00100000:3.0:1785944231.895467:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1785944231.895471:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944231.895473:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba78cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3476:x1872697906825856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.895487:0:3476:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1785944231.895492:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3476:1872697906825728:0@lo:400:kworker.0 00000100:00100000:3.0:1785944231.895499:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba78cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3476:x1872697906825856:12345-0@lo:400:kworker.0 Request processed in 27us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944231.895504:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1785944231.895510:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944231.895526:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906825984 00000100:00100000:3.0:1785944231.895529:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906825984 00000100:00100000:2.0:1785944231.895530:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3476:1872697906826240:0@lo:400:kworker.0 00000100:00100000:3.0:1785944231.895548:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906826368 00000100:00100000:3.0:1785944231.895551:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906826368 00000100:00100000:2.0:1785944231.895552:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944231.895561:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3476:1872697906826752:0@lo:400:kworker.0 00000100:00100000:3.0:1785944231.895568:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906826880 00000100:00100000:3.0:1785944231.895570:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906826880 00000100:00100000:2.0:1785944231.895579:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944231.895582:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906825728 00000100:00100000:3.0:1785944231.895584:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906825728 00000100:00100000:3.0:1785944231.895593:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906826240 00000100:00100000:2.0:1785944231.895594:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3476:1872697906825856:0@lo:400:kworker.0 00000100:00100000:3.0:1785944231.895595:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906826240 00000100:00100000:3.0:1785944231.895606:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906826752 00000100:00100000:3.0:1785944231.895608:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906826752 00000100:00100000:2.0:1785944231.895615:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906826496 00000100:00100000:2.0:1785944231.895617:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906826496 00000100:00100000:3.0:1785944231.895619:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1785944231.895638:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1872697906825984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.895657:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906826624 00000100:00100000:2.0:1785944231.895660:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906826624 00000100:00100000:3.0:1785944231.895668:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1872697906825984:12345-0@lo:400:kworker.0 Request processed in 44us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944231.895674:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1785944231.895676:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1785944231.895682:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1872697906826496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785944231.895684:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1785944231.895688:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba78cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3476:x1872697906826368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.895711:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1872697906826496:12345-0@lo:400:kworker.0 Request processed in 29us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944231.895713:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba78cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3476:x1872697906826368:12345-0@lo:400:kworker.0 Request processed in 25us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944231.895717:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1785944231.895718:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1785944231.895728:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1785944231.895733:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1785944231.895733:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1872697906826624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785944231.895738:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3476:x1872697906826880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785944231.895758:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3476:x1872697906826880:12345-0@lo:400:kworker.0 Request processed in 21us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944231.895758:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1872697906826624:12345-0@lo:400:kworker.0 Request processed in 24us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944231.895764:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1785944231.895764:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1785944231.895774:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1785944231.895780:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba78cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3476:x1872697906825728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.895781:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906825600 00000100:00100000:2.0:1785944231.895784:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906825600 00000100:00100000:3.0:1785944231.895804:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba78cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3476:x1872697906825728:12345-0@lo:400:kworker.0 Request processed in 25us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944231.895804:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1785944231.895810:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1785944231.895820:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1785944231.895822:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77517232-4860-4396-96b0-aef00b03546e+24:3473:x1872697906825600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785944231.895825:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b85f91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3476:x1872697906826240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785944231.895869:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b85f91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3476:x1872697906826240:12345-0@lo:400:kworker.0 Request processed in 43us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944231.895869:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77517232-4860-4396-96b0-aef00b03546e+24:3473:x1872697906825600:12345-0@lo:400:kworker.0 Request processed in 58us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944231.895876:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1785944231.895876:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1785944231.895888:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1785944231.895893:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc04a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3476:x1872697906826752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785944231.895918:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc04a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3476:x1872697906826752:12345-0@lo:400:kworker.0 Request processed in 24us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944231.895923:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:3.0:1785944231.895935:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785944231.895938:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785944231.895940:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785944231.895952:0:3473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77517232-4860-4396-96b0-aef00b03546e:3473:1872697906825600:0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.895976:0:3473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3473:1872697906826112:0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.895983:0:3473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3473:1872697906826624:0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.895990:0:3473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3473:1872697906825984:0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.895998:0:3473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3473:1872697906826496:0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.916949:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3476:1872697906825728:0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.917022:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3476:1872697906826240:0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.917033:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3476:1872697906826752:0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.917044:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3476:1872697906826368:0@lo:400:kworker.0 00000100:00100000:2.0:1785944231.917053:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3476:1872697906826880:0@lo:400:kworker.0 00000001:00080000:2.0:1785944232.046341:0:7264:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967304 is committed 00010000:00010000:2.0:1785944232.046380:0:3460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd840b lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x2:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046391:0:3460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd840b lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046398:0:3460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd840b lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046404:0:3460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967baee4a200 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:2.0:1785944232.046409:0:3460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd840b lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046432:0:3460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd840b lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046450:0:3460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x1c2f8c79 (ffff967b89124c00) 00010000:00010000:2.0:1785944232.046453:0:3460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944232.046457:0:3460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd840b lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x2:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046463:0:3460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd840b lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x2:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046486:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8474 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x2:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046491:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8474 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046496:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8474 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046501:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967bc0fa3c00 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:2.0:1785944232.046503:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8474 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046509:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8474 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046516:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x1c2f8c79 (ffff967b89124c00) 00010000:00010000:2.0:1785944232.046518:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944232.046521:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8474 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x2:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046532:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8474 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x2:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046548:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd847b lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046553:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd847b lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046559:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd847b lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046563:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967bc0fa3a00 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:2.0:1785944232.046566:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd847b lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046571:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd847b lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046578:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0xd04803f8 (ffff967b91b34900) 00010000:00010000:2.0:1785944232.046580:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944232.046582:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd847b lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046587:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd847b lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046597:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8482 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046603:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8482 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046615:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8482 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046620:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967bc0fa2800 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:2.0:1785944232.046633:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8482 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046639:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8482 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046648:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff967b922f1200) 00010000:00010000:2.0:1785944232.046650:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1785944232.046654:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8482 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944232.046660:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8482 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944232.150133:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1785944232.515105:0:6488:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1785944232.515137:0:6499:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1785944232.515250:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0d2ce00 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:6499:1872697906827008:0@lo:1000:dist_txn-0.0 00000100:00100000:0.0:1785944232.515320:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944232.515371:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b91981a80 going to sleep for 11 seconds 00000100:00100000:2.0:1785944232.518773:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906827008 00000100:00100000:2.0:1785944232.518786:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906827008 00000100:00100000:2.0:1785944232.518865:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1785944232.518876:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6499:x1872697906827008:12345-0@lo:1000:dist_txn-0.0 00000100:00100000:2.0:1785944232.519000:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6499:x1872697906827008:12345-0@lo:1000:dist_txn-0.0 Request processed in 126us (3679us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944232.519008:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1785944232.521953:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0d2ce00 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:6499:1872697906827008:0@lo:1000:dist_txn-0.0 00000004:00080000:0.0:1785944232.522003:0:6499:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff967b836bf6c0 with version 5 00000020:00080000:0.0:1785944232.522067:0:6499:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 1 cancel update log [0x240000401:0x3:0x0].1: rc = 0 00000020:00080000:0.0:1785944232.522442:0:6499:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 1 cancel update log [0x200000400:0x3:0x0].1: rc = 0 00000020:00080000:0.0:1785944232.522450:0:6499:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:2.0:1785944232.523289:0:7460:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff967b96a216c0 version 5 rpc_version 5 00000020:00100000:2.0:1785944232.523320:0:7460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785944232.523328:0:7460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff967bc04a6d80 x1872697906827264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785944232.523362:0:7460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc04a6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7460:1872697906827264:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785944232.523422:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944232.523475:0:7460:0:(client.c:2702:ptlrpc_set_wait()) set ffff967a88af4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785944232.523551:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906827264 00000100:00100000:3.0:1785944232.523557:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906827264 00000100:00100000:3.0:1785944232.523607:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1785944232.523617:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7460:x1872697906827264:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785944232.523901:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7460:x1872697906827264:12345-0@lo:1000:osp_up1-0.0 Request processed in 284us (477us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1785944232.523908:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1785944232.523947:0:7460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc04a6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7460:1872697906827264:0@lo:1000:osp_up1-0.0 00000001:00080000:0.0:1785944232.552487:0:9065:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1785944233.174931:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785944233.432311:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0fb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906827520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785944233.432372:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944233.432422:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785944233.432434:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3474:1872697906827392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785944233.432453:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944233.435326:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906827520 00000100:00100000:2.0:1785944233.435338:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906827520 00000100:00100000:2.0:1785944233.435398:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906827392 00000100:00100000:2.0:1785944233.435402:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906827392 00000100:00100000:2.0:1785944233.435421:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1785944233.435431:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1872697906827520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1785944233.435466:0:8101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785944233.435537:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1872697906827520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (3162us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944233.435544:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1785944233.435560:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1785944233.435567:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1872697906827392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785944233.435577:0:8101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785944233.435602:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1872697906827392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (3147us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944233.435608:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1785944233.435683:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3474:1872697906827392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785944233.435699:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0fb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906827520:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1785944233.436038:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785944234.196925:0:7273:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785944235.221117:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785944236.251275:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785944236.318766:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944236.318806:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944236.318839:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944236.318890:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944236.318911:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944236.318934:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880505856 00000100:00100000:0.0:1785944236.318942:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880505856 00000100:00100000:0.0:1785944236.318983:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 345 00000100:00100000:0.0:1785944236.318991:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:241f1677-b528-438b-8353-7b94a079ece4+10:2405:x1872697880505856:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1785944236.319050:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:241f1677-b528-438b-8353-7b94a079ece4+10:2405:x1872697880505856:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 59us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944236.319057:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 345 00000100:00100000:0.0:1785944236.319088:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880505984 00000100:00100000:0.0:1785944236.319092:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880505984 00000100:00100000:0.0:1785944236.319124:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880506112 00000100:00100000:0.0:1785944236.319126:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880506112 00000100:00100000:0.0:1785944236.319143:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 288 00000100:00100000:0.0:1785944236.319148:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+8:2405:x1872697880505984:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1785944236.319175:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+8:2405:x1872697880505984:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944236.319180:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 288 00000100:00100000:0.0:1785944236.319190:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 289 00000100:00100000:0.0:1785944236.319209:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+6:2405:x1872697880506112:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1785944236.319231:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+6:2405:x1872697880506112:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 23us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944236.319235:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 289 00000100:00100000:0.0:1785944236.319250:0:8336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880506240 00000100:00100000:0.0:1785944236.319253:0:8336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880506240 00000100:00100000:0.0:1785944236.319273:0:8336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880506368 00000100:00100000:0.0:1785944236.319275:0:8336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880506368 00000100:00100000:0.0:1785944236.319289:0:8336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 119 00000100:00100000:0.0:1785944236.319294:0:8336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+5:2405:x1872697880506240:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1785944236.319314:0:8336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+5:2405:x1872697880506240:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 20us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944236.319319:0:8336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 119 00000100:00100000:0.0:1785944236.319327:0:8336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00100000:0.0:1785944236.319332:0:8336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:2405:x1872697880506368:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1785944236.319348:0:8336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:2405:x1872697880506368:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 16us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944236.319353:0:8336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00080000:0.0:1785944236.319467:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785944236.319470:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785944236.319473:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1785944236.319474:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785944236.501074:0:3476:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785944236.502732:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3476:1872697906827776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1785944236.502803:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944236.502933:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfdeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3476:1872697906827648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785944236.502971:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944236.508187:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906827776 00000100:00100000:3.0:1785944236.508198:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906827776 00000100:00100000:3.0:1785944236.508246:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906827648 00000100:00100000:3.0:1785944236.508249:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906827648 00000100:00100000:3.0:1785944236.508264:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1785944236.508272:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3476:x1872697906827776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1785944236.508309:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1785944236.508369:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3476:x1872697906827776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (5565us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944236.508376:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1785944236.508391:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1785944236.508396:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3476:x1872697906827648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1785944236.508416:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1785944236.508438:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3476:x1872697906827648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 43us (5467us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944236.508458:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1785944236.508511:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3476:1872697906827776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785944236.508523:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfdeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3476:1872697906827648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785944237.013975:0:3473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfdeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3473:1872697906827904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785944237.014107:0:3473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944237.018057:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfdeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77517232-4860-4396-96b0-aef00b03546e:3475:1872697906828160:0@lo:400:kworker.0 00000100:00100000:0.0:1785944237.018125:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944237.018169:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785944237.018175:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfde9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3475:1872697906828288:0@lo:400:kworker.0 00000100:00100000:0.0:1785944237.018201:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944237.018229:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906828288 00000100:00100000:0.0:1785944237.018236:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906828288 00000100:00100000:0.0:1785944237.018274:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1785944237.018282:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1872697906828288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785944237.018328:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1872697906828288:12345-0@lo:400:kworker.0 Request processed in 47us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944237.018334:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1785944237.018374:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfde9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3475:1872697906828288:0@lo:400:kworker.0 00000100:00100000:2.0:1785944237.018536:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906828032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785944237.018564:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944237.018582:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785944237.018598:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfde8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906828416:0@lo:400:kworker.0 00000100:00100000:2.0:1785944237.018631:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944237.018655:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906828160 00000100:00100000:2.0:1785944237.018658:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906828160 00000100:00100000:2.0:1785944237.018681:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1785944237.018687:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77517232-4860-4396-96b0-aef00b03546e+24:3475:x1872697906828160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944237.018716:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77517232-4860-4396-96b0-aef00b03546e+24:3475:x1872697906828160:12345-0@lo:400:kworker.0 Request processed in 30us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944237.018721:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1785944237.018742:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906827904 00000100:00100000:2.0:1785944237.018745:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906827904 00000100:00100000:2.0:1785944237.018769:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906828032 00000100:00100000:2.0:1785944237.018771:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906828032 00000100:00100000:2.0:1785944237.018783:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1785944237.018788:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1872697906827904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785944237.018810:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785944237.018873:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1872697906827904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (4767us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944237.018879:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1785944237.018888:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1785944237.018894:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1872697906828032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785944237.018902:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785944237.018950:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1872697906828032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944237.018955:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1785944237.018970:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906828416 00000100:00100000:2.0:1785944237.018973:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906828416 00000100:00100000:2.0:1785944237.018992:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1785944237.019003:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3474:x1872697906828416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944237.019050:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3474:x1872697906828416:12345-0@lo:400:kworker.0 Request processed in 47us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944237.019055:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1785944237.019092:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785944237.019109:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfde8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906828416:0@lo:400:kworker.0 00000100:00100000:2.0:1785944237.019121:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906828032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785944237.020140:0:3473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfdeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3473:1872697906827904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785944237.022197:0:3476:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785944237.022211:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfdeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3476:1872697906828672:0@lo:400:kworker.0 00000100:00100000:1.0:1785944237.022258:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944237.022287:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785944237.022294:0:3473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfdebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3473:1872697906828544:0@lo:400:kworker.0 00000100:00100000:1.0:1785944237.022316:0:3473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944237.022343:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906828544 00000100:00100000:1.0:1785944237.022348:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906828544 00000100:00100000:1.0:1785944237.022382:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1785944237.022391:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfde9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1872697906828544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785944237.022455:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfdeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77517232-4860-4396-96b0-aef00b03546e:3475:1872697906828160:0@lo:400:kworker.0 00000100:00100000:1.0:1785944237.023572:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfde9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1872697906828544:12345-0@lo:400:kworker.0 Request processed in 1181us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944237.023580:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1785944237.023802:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785944237.023810:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3475:1872697906828800:0@lo:400:kworker.0 00000100:00100000:0.0:1785944237.023839:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944237.023885:0:9903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906828800 00000100:00100000:0.0:1785944237.023889:0:9903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906828800 00000100:00100000:3.0:1785944237.024118:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906828672 00000100:00100000:3.0:1785944237.024122:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906828672 00000100:00100000:3.0:1785944237.024152:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1785944237.024160:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfde8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3476:x1872697906828672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785944237.024199:0:9903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1785944237.024200:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfde8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3476:x1872697906828672:12345-0@lo:400:kworker.0 Request processed in 40us (1940us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944237.024205:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1785944237.024207:0:9903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1872697906828800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785944237.024245:0:9903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1872697906828800:12345-0@lo:400:kworker.0 Request processed in 39us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944237.024250:0:9903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1785944237.024261:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3475:1872697906828800:0@lo:400:kworker.0 00000100:00080000:0.0:1785944237.024272:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785944237.025014:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0d2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3476:1872697906829312:0@lo:400:kworker.0 00000100:00100000:2.0:1785944237.025044:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944237.025080:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfdeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3476:1872697906828672:0@lo:400:kworker.0 00000100:00100000:2.0:1785944237.025094:0:3476:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785944237.025100:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3476:1872697906829184:0@lo:400:kworker.0 00000100:00100000:2.0:1785944237.025125:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944237.025132:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906829056:0@lo:400:kworker.0 00000100:00100000:3.0:1785944237.025157:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944237.025189:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1785944237.025195:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3474:1872697906828928:0@lo:400:kworker.0 00000100:00100000:3.0:1785944237.025216:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944237.025232:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3474:1872697906829440:0@lo:400:kworker.0 00000100:00100000:3.0:1785944237.025249:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944237.025269:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906829312 00000100:00100000:3.0:1785944237.025273:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906829312 00000100:00100000:3.0:1785944237.025306:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906828928 00000100:00100000:3.0:1785944237.025308:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906828928 00000100:00100000:3.0:1785944237.025322:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906829440 00000100:00100000:3.0:1785944237.025324:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906829440 00000100:00100000:3.0:1785944237.025336:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1785944237.025342:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3476:x1872697906829312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785944237.025375:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3476:x1872697906829312:12345-0@lo:400:kworker.0 Request processed in 33us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944237.025381:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1785944237.025622:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906829184 00000100:00100000:2.0:1785944237.025626:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906829184 00000100:00100000:2.0:1785944237.025652:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906829056 00000100:00100000:2.0:1785944237.025655:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906829056 00000100:00100000:2.0:1785944237.025674:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1785944237.025681:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3476:x1872697906829184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944237.025713:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3476:x1872697906829184:12345-0@lo:400:kworker.0 Request processed in 32us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944237.025718:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1785944237.025730:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1785944237.025735:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3474:x1872697906829056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944237.025762:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3474:x1872697906829056:12345-0@lo:400:kworker.0 Request processed in 27us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944237.025774:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1785944237.026128:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1785944237.026139:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1872697906828928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785944237.026167:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1872697906828928:12345-0@lo:400:kworker.0 Request processed in 31us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944237.029089:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1785944237.029103:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1872697906829440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785944237.029173:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1872697906829440:12345-0@lo:400:kworker.0 Request processed in 74us (3922us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944237.029180:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1785944237.031822:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1785944237.031892:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3476:1872697906829184:0@lo:400:kworker.0 00000100:00100000:3.0:1785944237.031904:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0d2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3476:1872697906829312:0@lo:400:kworker.0 00000100:00100000:3.0:1785944237.031946:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3474:1872697906828928:0@lo:400:kworker.0 00000100:00100000:3.0:1785944237.031957:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3474:1872697906829440:0@lo:400:kworker.0 00000100:00100000:3.0:1785944237.031968:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906829056:0@lo:400:kworker.0 00000100:00100000:1.0:1785944237.032627:0:3473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfdebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3473:1872697906828544:0@lo:400:kworker.0 00000100:00080000:3.0:1785944237.032908:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785944237.032913:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1785944237.032916:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1785944237.104183:0:7264:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967305 is committed 00010000:00010000:3.0:1785944237.269130:0:7273:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785944238.294037:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785944238.552693:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3474:1872697906829568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785944238.552762:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944238.552837:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0fb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906829696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785944238.552880:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944238.552916:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906829568 00000100:00100000:3.0:1785944238.552923:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906829568 00000100:00100000:3.0:1785944238.552955:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906829696 00000100:00100000:3.0:1785944238.552958:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906829696 00000100:00100000:3.0:1785944238.552973:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1785944238.552980:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1872697906829568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785944238.553009:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785944238.553051:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1872697906829568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944238.553057:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1785944238.553074:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1785944238.553080:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1872697906829696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785944238.553089:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785944238.553114:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1872697906829696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944238.553120:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1785944238.553161:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3474:1872697906829568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785944238.553186:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0fb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906829696:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1785944239.318162:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785944240.345163:0:7273:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785944241.366013:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785944241.439265:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944241.439332:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944241.439361:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944241.439378:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944241.439979:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880506880 00000100:00100000:3.0:1785944241.439988:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880506880 00000100:00100000:3.0:1785944241.440046:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 123 00000100:00100000:3.0:1785944241.440056:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+5:2406:x1872697880506880:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1785944241.440119:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+5:2406:x1872697880506880:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 66us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944241.440136:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 123 00000100:00080000:3.0:1785944241.440158:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785944241.459906:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944241.459942:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880506496 00000100:00100000:0.0:1785944241.459950:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880506496 00000100:00100000:0.0:1785944241.459997:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 347 00000100:00100000:0.0:1785944241.460007:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:241f1677-b528-438b-8353-7b94a079ece4+10:2406:x1872697880506496:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1785944241.460069:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:241f1677-b528-438b-8353-7b94a079ece4+10:2406:x1872697880506496:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 62us (20706us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944241.460076:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 347 00000100:00100000:0.0:1785944241.460109:0:8336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880507008 00000100:00100000:0.0:1785944241.460112:0:8336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880507008 00000100:00100000:0.0:1785944241.460146:0:8336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 124 00000100:00100000:0.0:1785944241.460153:0:8336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:2406:x1872697880507008:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1785944241.460178:0:8336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:2406:x1872697880507008:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 26us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944241.460184:0:8336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 124 00000100:00080000:0.0:1785944241.460259:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785944241.465612:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880506624 00000100:00100000:1.0:1785944241.465624:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880506624 00000100:00100000:1.0:1785944241.465682:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880506752 00000100:00100000:1.0:1785944241.465690:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880506752 00000100:00100000:1.0:1785944241.465716:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 296 00000100:00100000:1.0:1785944241.465724:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+8:2406:x1872697880506624:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1785944241.465793:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+8:2406:x1872697880506624:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 69us (26534us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944241.465800:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 296 00000100:00100000:1.0:1785944241.465813:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 297 00000100:00100000:1.0:1785944241.465818:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+6:2406:x1872697880506752:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1785944241.465841:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+6:2406:x1872697880506752:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 22us (26462us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944241.465862:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 297 00000100:00080000:1.0:1785944241.465891:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1785944241.465895:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785944241.621130:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785944241.621150:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906829824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785944241.621210:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944241.621263:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906829824 00000100:00100000:2.0:1785944241.621270:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906829824 00000100:00100000:2.0:1785944241.621309:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1785944241.621317:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3475:x1872697906829824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1785944241.621351:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1785944241.621391:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3475:x1872697906829824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944241.621398:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1785944241.621434:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906829824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785944241.621604:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785944241.621614:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfdebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3474:1872697906829952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785944241.621641:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944241.621787:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906829952 00000100:00100000:1.0:1785944241.621792:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906829952 00000100:00100000:1.0:1785944241.621824:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1785944241.621831:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1872697906829952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1785944241.623633:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1785944241.623705:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1872697906829952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1872us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944241.623714:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1785944241.624316:0:3474:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1785944241.624323:0:3474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:0.0:1785944241.624347:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfdebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3474:1872697906829952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785944242.133236:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785944242.133261:0:3473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3473:1872697906830080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785944242.133328:0:3473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944242.133792:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906830080 00000100:00100000:3.0:1785944242.133800:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906830080 00000100:00100000:3.0:1785944242.133869:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1785944242.133880:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfdeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1872697906830080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1785944242.133924:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785944242.133969:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfdeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1872697906830080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944242.133977:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1785944242.134154:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3475:1872697906830208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785944242.134186:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944242.134265:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906830208 00000100:00100000:3.0:1785944242.134270:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906830208 00000100:00100000:3.0:1785944242.134305:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1785944242.134313:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc04a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1872697906830208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785944242.134323:0:8101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785944242.134359:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc04a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1872697906830208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944242.134365:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1785944242.134417:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3475:1872697906830208:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1785944242.134639:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785944242.134931:0:3473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3473:1872697906830080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785944242.136033:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785944242.136044:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3474:1872697906830464:0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136077:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944242.136108:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906830464 00000100:00100000:2.0:1785944242.136112:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906830464 00000100:00100000:2.0:1785944242.136144:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1785944242.136151:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1872697906830464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136191:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1872697906830464:12345-0@lo:400:kworker.0 Request processed in 40us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944242.136197:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1785944242.136224:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3474:1872697906830464:0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136255:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906830592:0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136288:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944242.136317:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906830592 00000100:00100000:2.0:1785944242.136320:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906830592 00000100:00100000:2.0:1785944242.136341:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1785944242.136347:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3474:x1872697906830592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136388:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3474:x1872697906830592:12345-0@lo:400:kworker.0 Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944242.136394:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1785944242.136418:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906830592:0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136449:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785944242.136454:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfdfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3474:1872697906830976:0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136473:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944242.136501:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a8869df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3474:1872697906831104:0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136517:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944242.136567:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785944242.136572:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc102b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3474:1872697906831488:0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136591:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944242.136625:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc102bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3474:1872697906831616:0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136642:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944242.136659:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906830976 00000100:00100000:2.0:1785944242.136662:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906830976 00000100:00100000:2.0:1785944242.136679:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906831104 00000100:00100000:2.0:1785944242.136681:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906831104 00000100:00100000:2.0:1785944242.136690:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906831488 00000100:00100000:2.0:1785944242.136692:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906831488 00000100:00100000:2.0:1785944242.136701:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906831616 00000100:00100000:2.0:1785944242.136703:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906831616 00000100:00100000:2.0:1785944242.136721:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1785944242.136726:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8869d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1872697906830976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136754:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8869d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1872697906830976:12345-0@lo:400:kworker.0 Request processed in 28us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944242.136760:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1785944242.136770:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1785944242.136775:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8869f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1872697906831104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136794:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8869f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1872697906831104:12345-0@lo:400:kworker.0 Request processed in 19us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944242.136799:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1785944242.136808:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1785944242.136813:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc1028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1872697906831488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136833:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc1028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1872697906831488:12345-0@lo:400:kworker.0 Request processed in 21us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944242.136839:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1785944242.136867:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1785944242.136873:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc102ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1872697906831616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136906:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc102ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1872697906831616:12345-0@lo:400:kworker.0 Request processed in 33us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944242.136911:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1785944242.136931:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc102bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3474:1872697906831616:0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136938:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc102b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3474:1872697906831488:0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136945:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a8869df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3474:1872697906831104:0@lo:400:kworker.0 00000100:00100000:2.0:1785944242.136952:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfdfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3474:1872697906830976:0@lo:400:kworker.0 00000100:00100000:0.0:1785944242.137152:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77517232-4860-4396-96b0-aef00b03546e:3476:1872697906830336:0@lo:400:kworker.0 00000100:00100000:0.0:1785944242.137181:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944242.137202:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3476:1872697906830848:0@lo:400:kworker.0 00000100:00100000:0.0:1785944242.137220:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944242.137232:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a895aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3476:1872697906831360:0@lo:400:kworker.0 00000100:00100000:0.0:1785944242.137249:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944242.137261:0:3476:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1785944242.137265:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3476:1872697906830720:0@lo:400:kworker.0 00000100:00100000:0.0:1785944242.137281:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944242.137292:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a8869ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3476:1872697906831232:0@lo:400:kworker.0 00000100:00100000:0.0:1785944242.137307:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944242.137325:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906830336 00000100:00100000:0.0:1785944242.137328:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906830336 00000100:00100000:0.0:1785944242.137349:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1785944242.137354:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77517232-4860-4396-96b0-aef00b03546e+24:3476:x1872697906830336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785944242.137392:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77517232-4860-4396-96b0-aef00b03546e+24:3476:x1872697906830336:12345-0@lo:400:kworker.0 Request processed in 38us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944242.137398:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1785944242.137419:0:8336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906831360 00000100:00100000:0.0:1785944242.137427:0:8336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906831360 00000100:00100000:0.0:1785944242.137447:0:8336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906831232 00000100:00100000:0.0:1785944242.137449:0:8336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906831232 00000100:00100000:0.0:1785944242.137463:0:8336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1785944242.137468:0:8336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba7d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3476:x1872697906831360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785944242.137492:0:8336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba7d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3476:x1872697906831360:12345-0@lo:400:kworker.0 Request processed in 25us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944242.137497:0:8336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1785944242.137506:0:8336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1785944242.137511:0:8336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3476:x1872697906831232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785944242.137528:0:8336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3476:x1872697906831232:12345-0@lo:400:kworker.0 Request processed in 18us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944242.137533:0:8336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1785944242.137576:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a8869ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3476:1872697906831232:0@lo:400:kworker.0 00000100:00100000:0.0:1785944242.137584:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77517232-4860-4396-96b0-aef00b03546e:3476:1872697906830336:0@lo:400:kworker.0 00000100:00100000:0.0:1785944242.137592:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a895aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3476:1872697906831360:0@lo:400:kworker.0 00000100:00100000:0.0:1785944242.137611:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906830720 00000100:00100000:0.0:1785944242.137613:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906830720 00000100:00100000:0.0:1785944242.137627:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1785944242.137631:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3476:x1872697906830720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785944242.137658:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3476:x1872697906830720:12345-0@lo:400:kworker.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944242.137663:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1785944242.137681:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3476:1872697906830720:0@lo:400:kworker.0 00000100:00100000:1.0:1785944242.137972:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906830848 00000100:00100000:1.0:1785944242.137976:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906830848 00000100:00100000:1.0:1785944242.138012:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1785944242.138018:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba7d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3476:x1872697906830848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785944242.138050:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba7d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3476:x1872697906830848:12345-0@lo:400:kworker.0 Request processed in 33us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944242.138056:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:1.0:1785944242.138069:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785944242.138072:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1785944242.138074:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785944242.139671:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3476:1872697906830848:0@lo:400:kworker.0 00010000:00010000:0.0:1785944242.390757:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785944243.428696:0:7273:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785944243.594021:0:14240:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 24Kb: cross-MDT RENAME_NOREPLACE fails if the target name exists ========================================================== 11:37:21 (1785944241) 00000100:00100000:1.0:1785944243.671124:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906831744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785944243.671192:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944243.671251:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785944243.671258:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfdebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3475:1872697906831872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785944243.671281:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944243.671310:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906831744 00000100:00100000:1.0:1785944243.671316:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906831744 00000100:00100000:1.0:1785944243.671349:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906831872 00000100:00100000:1.0:1785944243.671352:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906831872 00000100:00100000:1.0:1785944243.671363:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1785944243.671370:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfdeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1872697906831744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1785944243.671405:0:8101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785944243.671449:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfdeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1872697906831744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944243.671456:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1785944243.671485:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1785944243.671491:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1872697906831872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785944243.671500:0:8101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785944243.671536:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1872697906831872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944243.671551:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1785944243.671597:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfdebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3475:1872697906831872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785944243.671608:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906831744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785944243.753675:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944243.753736:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880507136 00000100:00100000:3.0:1785944243.753745:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880507136 00000100:00100000:3.0:1785944243.753801:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:3.0:1785944243.753823:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfdebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+8:12382:x1872697880507136:12345-192.168.203.21@tcp:41:stat.0 00000100:00080000:1.0:1785944243.754128:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1785944243.754212:0:10054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7713325056 00000100:00100000:3.0:1785944243.754288:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfdebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+8:12382:x1872697880507136:12345-192.168.203.21@tcp:41:stat.0 Request processed in 478us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944243.754295:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:0.0:1785944243.805834:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1785944243.806004:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880507264 00000100:00100000:2.0:1785944243.806013:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880507264 00000100:00100000:2.0:1785944243.806069:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:2.0:1785944243.806079:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a895aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+8:12386:x1872697880507264:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1785944243.806097:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785944243.806113:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809de00/0xd90bab03aefd84c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fc3d expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806165:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c600/0xd90bab03aefd84c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806177:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c600/0xd90bab03aefd84c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806188:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c600/0xd90bab03aefd84c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806200:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd84cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806206:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd84cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806212:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd84cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806418:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c600/0xd90bab03aefd84c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806426:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c600/0xd90bab03aefd84c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806442:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c600/0xd90bab03aefd84c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806448:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967b9809c600 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:2.0:1785944243.806452:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c600/0xd90bab03aefd84c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806458:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c600/0xd90bab03aefd84c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806469:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff967b84b00000) 00010000:00010000:2.0:1785944243.806472:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944243.806477:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c600/0xd90bab03aefd84c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806483:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c600/0xd90bab03aefd84c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806493:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd84cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806499:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd84cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806504:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd84cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806508:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967b9809ca00 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:2.0:1785944243.806511:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd84cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806526:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd84cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806535:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf49c0507 (ffff967b8acf8e00) 00010000:00010000:2.0:1785944243.806537:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944243.806550:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd84cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806556:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd84cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806734:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809de00/0xd90bab03aefd84c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc3d expref: 9 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806744:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff967b84b00000) 00010000:00010000:2.0:1785944243.806746:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944243.806750:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809de00/0xd90bab03aefd84c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc3d expref: 9 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.806758:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967b9809de00, rc 0) 00000100:00100000:2.0:1785944243.806820:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a895aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+8:12386:x1872697880507264:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 743us (993us total) trans 0 rc 301/301 00000100:00100000:2.0:1785944243.806827:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:3.0:1785944243.832739:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944243.832773:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880507520 00000100:00100000:3.0:1785944243.832781:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880507520 00000100:00100000:3.0:1785944243.833686:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:3.0:1785944243.833698:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+8:12386:x1872697880507520:12345-192.168.203.21@tcp:36:lfs.0 00010000:00010000:3.0:1785944243.833760:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785944243.833781:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967b80031800/0xd90bab03aefd83b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fbf0 expref: 8 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.833796:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff967b84b00000) 00010000:00010000:3.0:1785944243.833800:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785944243.834395:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640000/0xd90bab03aefd84d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.834409:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640000/0xd90bab03aefd84d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.834417:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640000/0xd90bab03aefd84d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.834428:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd84dd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.834434:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd84dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.834450:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd84dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785944243.839408:0:6466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].2, 1936 off36640 00000040:00080000:3.0:1785944243.841642:0:6466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].2, 2136 off37040 00000004:00080000:3.0:1785944243.841656:0:6466:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff967b8840f180 with version 6 00000004:00080000:0.0:1785944243.842078:0:7460:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff967b96a216c0 version 6 rpc_version 6 00000020:00100000:0.0:1785944243.842115:0:7460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785944243.842127:0:7460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff967ba6d4c700 x1872697906832128/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4000/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785944243.842150:0:7460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7460:1872697906832128:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785944243.842210:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944243.842252:0:7460:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b836bfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1785944243.842272:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906832128 00000100:00100000:0.0:1785944243.842277:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906832128 00000100:00100000:0.0:1785944243.842316:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1785944243.842323:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7460:x1872697906832128:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785944243.846098:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7460:x1872697906832128:12345-0@lo:1000:osp_up1-0.0 Request processed in 3768us (3881us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1785944243.846109:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1785944243.850183:0:7460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7460:1872697906832128:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1785944243.853765:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2200/0xd90bab03aefd84e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.853783:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2200/0xd90bab03aefd84e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.853794:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2200/0xd90bab03aefd84e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.853811:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3600/0xd90bab03aefd84eb lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.853818:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3600/0xd90bab03aefd84eb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.853830:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3600/0xd90bab03aefd84eb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.854053:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3200/0xd90bab03aefd84f2 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.854061:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3200/0xd90bab03aefd84f2 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.854071:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3200/0xd90bab03aefd84f2 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785944243.854094:0:6466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6466:1872697906832256:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1785944243.854149:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944243.854784:0:6466:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8983c540 going to sleep for 11 seconds 00000100:00100000:3.0:1785944243.859696:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906832256 00000100:00100000:3.0:1785944243.859709:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906832256 00000100:00100000:3.0:1785944243.859811:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1785944243.859821:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6466:x1872697906832256:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785944243.859858:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785944243.859893:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640800/0xd90bab03aefd84f9 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd90bab03aefd84f2 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.859921:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640800/0xd90bab03aefd84f9 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd90bab03aefd84f2 expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.859937:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640800/0xd90bab03aefd84f9 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd84f2 expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.859945:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff967b84b00e00) 00010000:00010000:3.0:1785944243.859948:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785944243.859952:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967a89640800, rc 0) 00000100:00100000:3.0:1785944243.860230:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6466:x1872697906832256:12345-0@lo:101:mdt00_001.0 Request processed in 410us (6079us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944243.860237:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1785944243.860316:0:6466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6466:1872697906832256:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1785944243.860335:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3200/0xd90bab03aefd84f2 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd84f9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.860349:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3200/0xd90bab03aefd84f2 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd84f9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785944243.860375:0:6466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9cc1730 reply state 00000000e0a91def transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3600/0xd90bab03aefd84eb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.860388:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3600/0xd90bab03aefd84eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.860395:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff967b922f1700) 00010000:00010000:1.0:1785944243.860398:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785944243.860400:0:6466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785944243.860406:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3200/0xd90bab03aefd84f2 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd84f9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.860426:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3200/0xd90bab03aefd84f2 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd84f9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785944243.860438:0:6466:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000004:00010000:1.0:1785944243.860447:0:6466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9cc1730 reply state 00000000e0a91def transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2200/0xd90bab03aefd84e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.860458:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2200/0xd90bab03aefd84e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.860464:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff967b922f1000) 00010000:00010000:1.0:1785944243.860466:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785944243.860468:0:6466:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1785944243.860473:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x5:0x0]: returning size 1024 00010000:00010000:1.0:1785944243.860482:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640000/0xd90bab03aefd84d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.860488:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640000/0xd90bab03aefd84d6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.860495:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640000/0xd90bab03aefd84d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.860501:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967a89640000 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:1.0:1785944243.860505:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640000/0xd90bab03aefd84d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.860514:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640000/0xd90bab03aefd84d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.860524:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff967b84b00000) 00010000:00010000:1.0:1785944243.860532:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785944243.860537:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640000/0xd90bab03aefd84d6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.860552:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640000/0xd90bab03aefd84d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785944243.860574:0:6466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9cc1730 reply state 00000000e0a91def transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd84dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.860584:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd84dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.860589:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf49c0507 (ffff967b84b00a00) 00010000:00010000:1.0:1785944243.860591:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785944243.860593:0:6466:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1785944243.860662:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+9:12386:x1872697880507520:12345-192.168.203.21@tcp:36:lfs.0 Request processed in 26964us (27929us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1785944243.860668:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:0.0:1785944243.877375:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944243.877446:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880507648 00000100:00100000:3.0:1785944243.877455:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880507648 00000100:00100000:3.0:1785944243.877500:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 53 00000100:00100000:3.0:1785944243.877510:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfd16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+9:12387:x1872697880507648:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1785944243.877532:0:10054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785944243.877559:0:10054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641c00/0xd90bab03aefd8500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fc44 expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.877626:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640e00/0xd90bab03aefd8507 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.877639:0:10054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640e00/0xd90bab03aefd8507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.877650:0:10054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640e00/0xd90bab03aefd8507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785944243.877702:0:10054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1785944243.877705:0:10054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 2 00000004:00010000:3.0:1785944243.877727:0:10054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640e00/0xd90bab03aefd8507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.877749:0:10054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641c00/0xd90bab03aefd8500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc44 expref: 11 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.877765:0:10054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640e00/0xd90bab03aefd8507 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc44 expref: 10 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.877774:0:10054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff967b84b00000) 00010000:00010000:3.0:1785944243.877777:0:10054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785944243.877791:0:10054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967a89640e00, rc 0) 00000100:00100000:3.0:1785944243.877885:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfd16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+10:12387:x1872697880507648:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 376us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944243.877891:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 53 00000100:00100000:2.0:1785944243.881939:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1785944243.882091:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880507776 00000100:00100000:1.0:1785944243.882100:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880507776 00000100:00100000:1.0:1785944243.882146:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 54 00000100:00100000:1.0:1785944243.882155:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc102b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+10:12387:x1872697880507776:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1785944243.882173:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785944243.882192:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4b400/0xd90bab03aefd850e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fc4b expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882247:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4ba00/0xd90bab03aefd8515 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882258:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4ba00/0xd90bab03aefd8515 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882280:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4ba00/0xd90bab03aefd8515 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882291:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4b800/0xd90bab03aefd851c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882298:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4b800/0xd90bab03aefd851c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882304:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4b800/0xd90bab03aefd851c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882403:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a800/0xd90bab03aefd8523 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882412:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a800/0xd90bab03aefd8523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882419:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a800/0xd90bab03aefd8523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785944243.882483:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x5:0x0]: returning size 1024 00000004:00200000:1.0:1785944243.882488:0:6465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 2 MDT count 2 00000004:00010000:1.0:1785944243.882509:0:6465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a800/0xd90bab03aefd8523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882519:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4ba00/0xd90bab03aefd8515 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882526:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4ba00/0xd90bab03aefd8515 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882554:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4ba00/0xd90bab03aefd8515 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882560:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967baee4ba00 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:1.0:1785944243.882573:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4ba00/0xd90bab03aefd8515 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882582:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4ba00/0xd90bab03aefd8515 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882594:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff967b84b00000) 00010000:00010000:1.0:1785944243.882596:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785944243.882601:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4ba00/0xd90bab03aefd8515 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882608:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4ba00/0xd90bab03aefd8515 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882621:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4b800/0xd90bab03aefd851c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882627:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4b800/0xd90bab03aefd851c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882632:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4b800/0xd90bab03aefd851c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882637:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967baee4b800 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:1.0:1785944243.882640:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4b800/0xd90bab03aefd851c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882656:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4b800/0xd90bab03aefd851c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882665:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf49c0507 (ffff967b84b00a00) 00010000:00010000:1.0:1785944243.882667:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785944243.882671:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4b800/0xd90bab03aefd851c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882676:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4b800/0xd90bab03aefd851c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882701:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4b400/0xd90bab03aefd850e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc4b expref: 12 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882713:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a800/0xd90bab03aefd8523 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc4b expref: 11 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.882720:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff967b922f1000) 00010000:00010000:1.0:1785944243.882722:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1785944243.882725:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967baee4a800, rc 0) 00000100:00100000:1.0:1785944243.882780:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc102b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+11:12387:x1872697880507776:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 625us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944243.882787:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 54 00000100:00100000:0.0:1785944243.886443:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1785944243.886671:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880507904 00000100:00100000:1.0:1785944243.886679:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880507904 00000100:00100000:1.0:1785944243.886726:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:1.0:1785944243.886733:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfd14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+11:12387:x1872697880507904:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1785944243.886763:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785944243.886779:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4b000/0xd90bab03aefd852a lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fc52 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.886838:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a400/0xd90bab03aefd8531 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.886882:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a400/0xd90bab03aefd8531 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.886892:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a400/0xd90bab03aefd8531 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785944243.886940:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 1024 00000004:00200000:1.0:1785944243.886944:0:6466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1785944243.886977:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4b000/0xd90bab03aefd852a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc52 expref: 13 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.887003:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a400/0xd90bab03aefd8531 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc52 expref: 12 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.887012:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff967b922f1700) 00010000:00010000:1.0:1785944243.887015:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785944243.887017:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967baee4a400, rc 0) 00000100:00100000:1.0:1785944243.887058:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfd14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+12:12387:x1872697880507904:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 325us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944243.887064:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:2.0:1785944243.890336:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1785944243.890397:0:9903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880508032 00000100:00100000:1.0:1785944243.890405:0:9903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880508032 00000100:00100000:1.0:1785944243.890475:0:9903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:1.0:1785944243.890485:0:9903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc102bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+6:12387:x1872697880508032:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1785944243.890500:0:9903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785944243.890515:0:9903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b400/0xd90bab03aefd8538 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fc59 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1785944243.890653:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1785944243.890682:0:9903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.890694:0:9903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640800/0xd90bab03aefd84f9 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd84f2 expref: 6 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.890701:0:9903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 4/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.890729:0:9903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640800/0xd90bab03aefd84f9 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd90bab03aefd84f2 expref: 6 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785944243.890756:0:9903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:9903:1872697906832384:0@lo:104: 00000100:00100000:1.0:1785944243.890792:0:9903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944243.890833:0:9903:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b86c770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785944243.890899:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906832384 00000100:00100000:3.0:1785944243.890904:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906832384 00000100:00100000:3.0:1785944243.890933:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1785944243.890939:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:9903:x1872697906832384:12345-0@lo:104: 00010000:00010000:3.0:1785944243.890949:0:8114:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3200/0xd90bab03aefd84f2 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd90bab03aefd84f9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.891009:0:8114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785944243.891015:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:9903:x1872697906832384:12345-0@lo:104: Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944243.891021:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1785944243.891096:0:9903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:9903:1872697906832384:0@lo:104: 00010000:00010000:2.0:1785944243.891114:0:9903:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.891257:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785944243.891264:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3200/0xd90bab03aefd84f2 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd90bab03aefd84f9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.891272:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967bc0fa3200 already unused, calling callback (ffffffffc2226ee0) 00010000:00010000:0.0:1785944243.891276:0:6453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3200/0xd90bab03aefd84f2 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd90bab03aefd84f9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785944243.891285:0:6453:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3200/0xd90bab03aefd84f2 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd90bab03aefd84f9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.891309:0:6453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3200/0xd90bab03aefd84f2 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd90bab03aefd84f9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.891320:0:6453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785944243.891344:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3200/0xd90bab03aefd84f2 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd90bab03aefd84f9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.891350:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3200/0xd90bab03aefd84f2 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd90bab03aefd84f9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.891365:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785944243.891367:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785944243.891368:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785944243.891404:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785944243.891416:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfd17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3474:1872697906832512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785944243.891444:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944243.891574:0:9943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906832512 00000100:00100000:0.0:1785944243.891579:0:9943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906832512 00010000:00010000:0.0:1785944243.891599:0:9943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640800/0xd90bab03aefd84f9 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd90bab03aefd84f2 expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785944243.891629:0:9943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1785944243.891635:0:9943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3474:x1872697906832512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785944243.891643:0:9943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1785944243.921717:0:7264:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967306 is committed 00010000:00010000:0.0:1785944243.927281:0:9943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640800/0xd90bab03aefd84f9 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd90bab03aefd84f2 expref: 6 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.927300:0:9943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff967b84b00e00) 00010000:00010000:0.0:1785944243.927305:0:9943:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.927314:0:9943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.927336:0:9943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.927366:0:9943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785944243.927435:0:9943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3474:x1872697906832512:12345-0@lo:103:ldlm_bl.0 Request processed in 35799us (35989us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944243.927445:0:9943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1785944243.927534:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfd17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3474:1872697906832512:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785944243.927647:0:9903:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.927655:0:9903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785944243.927800:0:9903:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 7168 00000004:00200000:1.0:1785944243.927806:0:9903:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 2 MDT count 2 00010000:00010000:1.0:1785944243.927939:0:9903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b400/0xd90bab03aefd8538 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc59 expref: 8 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.927954:0:9903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc59 expref: 7 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.927960:0:9903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff967b84b00e00) 00010000:00010000:1.0:1785944243.927963:0:9903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785944243.927965:0:9903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967baee4b800, rc 0) 00000100:00100000:1.0:1785944243.928070:0:9903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc102bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:12387:x1872697880508032:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 37586us (37737us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944243.928078:0:9903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:2.0:1785944243.931532:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944243.931633:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880508160 00000100:00100000:0.0:1785944243.931642:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880508160 00000100:00100000:0.0:1785944243.931694:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:0.0:1785944243.931703:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc1028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:12387:x1872697880508160:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1785944243.931721:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785944243.931739:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2a00/0xd90bab03aefd8546 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fc60 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.931795:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd854d lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.931807:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd854d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.931831:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd854d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.931866:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8554 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.931874:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8554 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932148:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8554 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932375:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd854d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932383:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd854d lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932390:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd854d lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932396:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967bc0fa3a00 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:0.0:1785944243.932399:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd854d lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932406:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd854d lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932418:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff967b84b00e00) 00010000:00010000:0.0:1785944243.932421:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785944243.932425:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd854d lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932430:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa3a00/0xd90bab03aefd854d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932441:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8554 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932447:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8554 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932458:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8554 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932462:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967bc0fa2600 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:0.0:1785944243.932465:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8554 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932470:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8554 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932478:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8864fe66 (ffff967b922f1100) 00010000:00010000:0.0:1785944243.932480:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785944243.932483:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8554 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932488:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8554 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932519:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2a00/0xd90bab03aefd8546 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc60 expref: 8 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932527:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff967b84b00e00) 00010000:00010000:0.0:1785944243.932529:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785944243.932533:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2a00/0xd90bab03aefd8546 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc60 expref: 8 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.932550:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967bc0fa2a00, rc 0) 00000100:00100000:0.0:1785944243.932665:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc1028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:12387:x1872697880508160:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 962us (1136us total) trans 0 rc 301/301 00000100:00100000:0.0:1785944243.932681:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:0.0:1785944243.937315:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944243.937380:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880508288 00000100:00100000:3.0:1785944243.937388:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880508288 00000100:00100000:3.0:1785944243.937440:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00100000:3.0:1785944243.937450:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfd17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+12:12387:x1872697880508288:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1785944243.937470:0:10054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785944243.937488:0:10054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641c00/0xd90bab03aefd855b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fc67 expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.937555:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641800/0xd90bab03aefd8562 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.937588:0:10054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641800/0xd90bab03aefd8562 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.937599:0:10054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641800/0xd90bab03aefd8562 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785944243.937702:0:10054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x5:0x0]: returning size 1024 00000004:00200000:3.0:1785944243.937707:0:10054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 2 MDT count 2 00000004:00010000:3.0:1785944243.937730:0:10054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641800/0xd90bab03aefd8562 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.937756:0:10054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641c00/0xd90bab03aefd855b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc67 expref: 14 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.937773:0:10054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641800/0xd90bab03aefd8562 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc67 expref: 13 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.937783:0:10054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff967b922f1000) 00010000:00010000:3.0:1785944243.937786:0:10054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785944243.937790:0:10054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967a89641800, rc 0) 00000100:00100000:3.0:1785944243.937835:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfd17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+13:12387:x1872697880508288:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 386us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944243.937870:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00100000:1.0:1785944243.944134:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1785944243.944216:0:9903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880508544 00000100:00100000:2.0:1785944243.944225:0:9903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880508544 00000100:00100000:2.0:1785944243.944275:0:9903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:2.0:1785944243.944284:0:9903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+13:12387:x1872697880508544:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1785944243.944301:0:9903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785944243.944319:0:9903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c000/0xd90bab03aefd8569 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fc6e expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785944243.944467:0:9903:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x5:0x0]: returning size 1024 00010000:00010000:2.0:1785944243.944592:0:9903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c000/0xd90bab03aefd8569 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc6e expref: 15 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.944606:0:9903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff967b84b00000) 00010000:00010000:2.0:1785944243.944609:0:9903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785944243.944614:0:9903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c000/0xd90bab03aefd8569 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc6e expref: 15 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.944626:0:9903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967b9809c000, rc 0) 00000100:00100000:2.0:1785944243.944679:0:9903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+14:12387:x1872697880508544:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 396us (551us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1785944243.944686:0:9903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:2.0:1785944243.947672:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944243.947750:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880508800 00000100:00100000:0.0:1785944243.947757:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880508800 00000100:00100000:0.0:1785944243.947802:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:0.0:1785944243.947820:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+14:12387:x1872697880508800:12345-192.168.203.21@tcp:36:lfs.0 00000100:00100000:1.0:1785944243.948232:0:6467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906832640:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785944243.948275:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944243.948304:0:6467:0:(client.c:2702:ptlrpc_set_wait()) set ffff967a888310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785944243.948373:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906832640 00000100:00100000:0.0:1785944243.948378:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906832640 00000100:00100000:0.0:1785944243.948412:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1785944243.948419:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6467:x1872697906832640:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1785944243.948720:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6467:x1872697906832640:12345-0@lo:1000:mdt00_002.0 Request processed in 300us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944243.948727:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1785944243.948794:0:6467:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1785944243.948800:0:6467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1785944243.948828:0:6467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906832640:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785944243.948896:0:6467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906832768:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785944243.948917:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944243.948935:0:6467:0:(client.c:2702:ptlrpc_set_wait()) set ffff967a888310c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785944243.949033:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906832768 00000100:00100000:3.0:1785944243.949038:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906832768 00000100:00100000:3.0:1785944243.949072:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1785944243.949079:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6467:x1872697906832768:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785944243.949135:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6467:x1872697906832768:12345-0@lo:1000:mdt00_002.0 Request processed in 57us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944243.949149:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1785944243.949405:0:6467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906832768:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785944243.949440:0:6467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906832896:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785944243.949464:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944243.949487:0:6467:0:(client.c:2702:ptlrpc_set_wait()) set ffff967a888310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785944243.949550:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906832896 00000100:00100000:0.0:1785944243.949555:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906832896 00000100:00100000:0.0:1785944243.949590:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1785944243.949596:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b86c86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6467:x1872697906832896:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1785944243.949731:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b86c86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6467:x1872697906832896:12345-0@lo:1000:mdt00_002.0 Request processed in 134us (265us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785944243.949738:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1785944243.949977:0:6467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906832896:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1785944243.950029:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.950038:0:6467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.950047:0:6467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785944243.950072:0:6467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967b86c86680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906833024:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1785944243.950098:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944243.950116:0:6467:0:(client.c:2702:ptlrpc_set_wait()) set ffff967a88831a80 going to sleep for 11 seconds 00000100:00100000:0.0:1785944243.950204:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906833024 00000100:00100000:0.0:1785944243.950208:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906833024 00000100:00100000:0.0:1785944243.950234:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1785944243.950240:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6467:x1872697906833024:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1785944243.950248:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785944243.950260:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd857e lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd90bab03aefd8577 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.950287:0:6471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc59 expref: 6 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.950297:0:6471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd857e lrc: 4/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd90bab03aefd8577 expref: 6 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.950325:0:6471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc59 expref: 6 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.950338:0:6471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc59 expref: 6 pid: 9903 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785944243.950348:0:6471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967b88cdc380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6471:1872697906833152:192.168.203.21@tcp:104: 00000100:00100000:0.0:1785944243.950409:0:6471:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b86c77840 going to sleep for 11 seconds 00000100:00100000:0.0:1785944243.954253:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944243.954356:0:6471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967b88cdc380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6471:1872697906833152:192.168.203.21@tcp:104: 00010000:00010000:3.0:1785944243.954384:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd857e lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd8577 expref: 6 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.954395:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff967b84b00e00) 00010000:00010000:3.0:1785944243.954398:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785944243.954402:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd857e lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd8577 expref: 6 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.954412:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967bc0fa2600, rc 0) 00000100:00100000:3.0:1785944243.954470:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6467:x1872697906833024:12345-0@lo:101:mdt00_002.0 Request processed in 4229us (4370us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944243.954478:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1785944243.954585:0:6467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967b86c86680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906833024:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1785944243.954601:0:6467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.954611:0:6467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785944243.954747:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880508928 00000100:00100000:2.0:1785944243.954754:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880508928 00010000:00010000:2.0:1785944243.954778:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc59 expref: 7 pid: 9903 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785944243.954824:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:2.0:1785944243.954832:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:2408:x1872697880508928:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785944243.954879:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785944243.954885:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc59 expref: 7 pid: 9903 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.954896:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc59 expref: 7 pid: 9903 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.954913:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd853f lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc59 expref: 7 pid: 9903 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.954925:0:6450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff967b84b00e00) 00010000:00010000:2.0:1785944243.954929:0:6450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd857e lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd8577 expref: 5 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.954937:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd857e lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd90bab03aefd8577 expref: 5 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.954944:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd857e lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd90bab03aefd8577 expref: 5 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.954970:0:6450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd857e lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd8577 expref: 5 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785944243.955005:0:6450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6450:1872697906833280:0@lo:105: 00000100:00100000:2.0:1785944243.955040:0:6450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944243.955073:0:6450:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b88403900 going to sleep for 11 seconds 00000100:00100000:3.0:1785944243.955187:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906833280 00000100:00100000:3.0:1785944243.955191:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906833280 00000100:00100000:3.0:1785944243.955221:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1785944243.955227:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfdfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6450:x1872697906833280:12345-0@lo:105: 00010000:00010000:3.0:1785944243.955235:0:6449:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.955242:0:6449:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.955249:0:6449:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.955265:0:6449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.955270:0:6449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.955277:0:6449:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.955289:0:6449:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff967baee4b400) 00000100:00100000:3.0:1785944243.955318:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfdfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6450:x1872697906833280:12345-0@lo:105: Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944243.955324:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1785944243.955345:0:6450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6450:1872697906833280:0@lo:105: 00010000:00010000:3.0:1785944243.955354:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785944243.955385:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+6:2408:x1872697880508928:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 554us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944243.955392:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 47 00010000:00010000:0.0:1785944243.955884:0:6467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.955893:0:6467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785944243.955913:0:6467:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1785944243.955946:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3a00/0xd90bab03aefd8585 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.955953:0:6467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3a00/0xd90bab03aefd8585 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.955974:0:6467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3a00/0xd90bab03aefd8585 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785944243.956000:0:6467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967b88cdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906833408:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1785944243.956029:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944243.956054:0:6467:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b86c770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785944243.956151:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906833408 00000100:00100000:3.0:1785944243.956155:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906833408 00000100:00100000:3.0:1785944243.956188:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1785944243.956196:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6467:x1872697906833408:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1785944243.956210:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785944243.956223:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640a00/0xd90bab03aefd858c lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd90bab03aefd8585 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.956251:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640a00/0xd90bab03aefd858c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd90bab03aefd8585 expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.956262:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640a00/0xd90bab03aefd858c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd8585 expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.956268:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8864fe66 (ffff967b84b00400) 00010000:00010000:3.0:1785944243.956271:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785944243.956274:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967a89640a00, rc 0) 00000100:00100000:3.0:1785944243.956313:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6467:x1872697906833408:12345-0@lo:101:mdt00_002.0 Request processed in 118us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944243.956319:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1785944243.956464:0:6467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967b88cdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906833408:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1785944243.956475:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3a00/0xd90bab03aefd8585 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd858c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.956484:0:6467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3a00/0xd90bab03aefd8585 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd858c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785944243.956495:0:6467:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:0.0:1785944243.956522:0:6467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967b88cdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906833536:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1785944243.956557:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944243.956585:0:6467:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b86c77840 going to sleep for 11 seconds 00000100:00100000:3.0:1785944243.956672:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906833536 00000100:00100000:3.0:1785944243.956677:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906833536 00000100:00100000:3.0:1785944243.956707:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1785944243.956713:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6467:x1872697906833536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785944243.956964:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6467:x1872697906833536:12345-0@lo:1000:mdt00_002.0 Request processed in 250us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944243.956971:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1785944243.957132:0:6467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967b88cdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906833536:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785944243.957170:0:6467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906833664:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785944243.957195:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944243.957218:0:6467:0:(client.c:2702:ptlrpc_set_wait()) set ffff967a888310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785944243.957361:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906833664 00000100:00100000:0.0:1785944243.957365:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906833664 00000100:00100000:0.0:1785944243.957394:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1785944243.957401:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbb261050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6467:x1872697906833664:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1785944243.957556:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbb261050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6467:x1872697906833664:12345-0@lo:1000:mdt00_002.0 Request processed in 154us (358us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785944243.957646:0:6467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906833664:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785944243.957712:0:6467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906833792:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785944243.957736:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944243.957756:0:6467:0:(client.c:2702:ptlrpc_set_wait()) set ffff967a888310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785944243.957798:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1785944243.958074:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906833792 00000100:00100000:2.0:1785944243.958078:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906833792 00000100:00100000:2.0:1785944243.958098:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1785944243.958104:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6467:x1872697906833792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785944243.958220:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6467:x1872697906833792:12345-0@lo:1000:mdt00_002.0 Request processed in 116us (483us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785944243.958226:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1785944243.958285:0:6467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906833792:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785944243.958324:0:6467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906833920:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785944243.958344:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944243.958363:0:6467:0:(client.c:2702:ptlrpc_set_wait()) set ffff967a88831300 going to sleep for 11 seconds 00000100:00100000:0.0:1785944243.958551:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906833920 00000100:00100000:0.0:1785944243.958556:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906833920 00000100:00100000:0.0:1785944243.958743:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1785944243.958751:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6467:x1872697906833920:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1785944243.958806:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6467:x1872697906833920:12345-0@lo:1000:mdt00_002.0 Request processed in 56us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944243.958821:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1785944243.958885:0:6467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906833920:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785944243.958938:0:6467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906834048:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785944243.958959:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944243.960132:0:6467:0:(client.c:2702:ptlrpc_set_wait()) set ffff967a88831300 going to sleep for 11 seconds 00000100:00100000:3.0:1785944243.960198:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906834048 00000100:00100000:3.0:1785944243.960202:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906834048 00000100:00100000:3.0:1785944243.960225:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1785944243.960230:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6467:x1872697906834048:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785944243.960287:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6467:x1872697906834048:12345-0@lo:1000:mdt00_002.0 Request processed in 56us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944243.960293:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1785944243.960357:0:6467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906834048:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785944243.960400:0:6467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906834176:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785944243.960423:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944243.960444:0:6467:0:(client.c:2702:ptlrpc_set_wait()) set ffff967a88831300 going to sleep for 11 seconds 00000100:00100000:3.0:1785944243.960488:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906834176 00000100:00100000:3.0:1785944243.960492:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906834176 00000100:00100000:3.0:1785944243.960510:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1785944243.960515:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6467:x1872697906834176:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785944243.960580:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6467:x1872697906834176:12345-0@lo:1000:mdt00_002.0 Request processed in 64us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944243.960586:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1785944243.960672:0:6467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6467:1872697906834176:0@lo:1000:mdt00_002.0 00000040:00080000:1.0:1785944243.961518:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].3, 1080 off37720 00000040:00080000:1.0:1785944243.961620:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].3, 1224 off38264 00000004:00080000:1.0:1785944243.961626:0:6467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff967a888310c0 with version 7 00000004:00080000:3.0:1785944243.961821:0:7460:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff967b96a216c0 version 7 rpc_version 7 00000020:00100000:3.0:1785944243.961840:0:7460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785944243.962045:0:7460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff967bc0fb9500 x1872697906834432/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2240/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785944243.962062:0:7460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0fb9500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7460:1872697906834432:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785944243.962098:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944243.962121:0:7460:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840f300 going to sleep for 11 seconds 00000100:00100000:2.0:1785944243.962165:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906834432 00000100:00100000:2.0:1785944243.962170:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906834432 00000100:00100000:2.0:1785944243.962203:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1785944243.962209:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7460:x1872697906834432:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785944243.962728:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:7460:x1872697906834432:12345-0@lo:1000:osp_up1-0.0 Request processed in 519us (629us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1785944243.962736:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1785944243.963139:0:7460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0fb9500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7460:1872697906834432:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1785944243.963230:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c800/0xd90bab03aefd8593 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.963244:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c800/0xd90bab03aefd8593 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.963254:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c800/0xd90bab03aefd8593 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785944243.963266:0:6467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000215888e5 reply state 000000006dd213dd transno 4294967316 ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c800/0xd90bab03aefd8593 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.963275:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c800/0xd90bab03aefd8593 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.963288:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff967b8acf8e00) 00010000:00010000:2.0:1785944243.963290:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785944243.963294:0:6467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1785944243.963298:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x6:0x0]: returning size 1024 00000004:00080000:2.0:1785944243.963304:0:6467:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1785944243.963311:0:6467:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.963318:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.963324:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.963347:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1785944243.963351:0:6467:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1785944243.963356:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3a00/0xd90bab03aefd8585 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd858c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.963361:0:6467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3a00/0xd90bab03aefd8585 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd858c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785944243.963427:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+16:12387:x1872697880508800:12345-192.168.203.21@tcp:36:lfs.0 Request processed in 15615us (15758us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1785944243.963435:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 60 00010000:00010000:3.0:1785944243.965862:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785944243.965883:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.965893:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967baee4b400 already unused, calling callback (ffffffffc2226ee0) 00010000:00010000:3.0:1785944243.965898:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785944243.965907:0:6454:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.965938:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.965953:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785944243.965980:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.966046:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff967baee4b400/0xd90bab03aefd8577 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd90bab03aefd857e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.966064:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785944243.966066:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785944243.966068:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785944243.966076:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785944243.966089:0:3473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3473:1872697906834560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785944243.966132:0:3473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944243.966166:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906834560 00000100:00100000:3.0:1785944243.966172:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906834560 00000100:00100000:3.0:1785944243.966208:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785944243.966215:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3473:x1872697906834560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785944243.966226:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785944243.966242:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967bc0fa2600/0xd90bab03aefd857e lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd90bab03aefd8577 expref: 8 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944243.966254:0:6452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff967b84b00e00) 00010000:00010000:3.0:1785944243.966262:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785944243.966294:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3473:x1872697906834560:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944243.966301:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785944243.966336:0:3473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3473:1872697906834560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785944243.966557:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1785944243.966671:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880509184 00000100:00100000:2.0:1785944243.966676:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880509184 00000100:00100000:2.0:1785944243.966706:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:2.0:1785944243.966718:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+16:12387:x1872697880509184:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1785944243.966914:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+17:12387:x1872697880509184:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 196us (358us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1785944243.966920:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:2.0:1785944243.981746:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944243.981834:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880509312 00000100:00100000:0.0:1785944243.981880:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880509312 00000100:00100000:0.0:1785944243.981929:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:0.0:1785944243.981937:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfdfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+17:12388:x1872697880509312:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1785944243.981960:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785944243.981990:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3000/0xd90bab03aefd859a lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fc75 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982049:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd85a1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982062:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd85a1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982072:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd85a1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982087:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd85a8 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982094:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd85a8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982100:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd85a8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982193:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd85a1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982200:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd85a1 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982206:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd85a1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982211:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967bc0fa3c00 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:0.0:1785944243.982215:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd85a1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982222:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd85a1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982233:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff967b922f1700) 00010000:00010000:0.0:1785944243.982236:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785944243.982240:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd85a1 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982246:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd85a1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982257:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd85a8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982262:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd85a8 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982267:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd85a8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982278:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967bc0fa2600 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:0.0:1785944243.982281:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd85a8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982287:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd85a8 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982295:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x79085f7a (ffff967b922f1900) 00010000:00010000:0.0:1785944243.982298:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785944243.982300:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd85a8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982306:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd85a8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982336:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3000/0xd90bab03aefd859a lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc75 expref: 18 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982346:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff967b922f1700) 00010000:00010000:0.0:1785944243.982348:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785944243.982352:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3000/0xd90bab03aefd859a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc75 expref: 18 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944243.982361:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967bc0fa3000, rc 0) 00000100:00100000:0.0:1785944243.982409:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfdfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+17:12388:x1872697880509312:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 472us (670us total) trans 0 rc 301/301 00000100:00100000:0.0:1785944243.982415:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:3.0:1785944243.987941:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1785944243.988201:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880509440 00000100:00100000:1.0:1785944243.988209:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880509440 00000100:00100000:1.0:1785944243.988257:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:1.0:1785944243.988266:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+6:12388:x1872697880509440:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1785944243.988283:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785944243.988303:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a000/0xd90bab03aefd85af lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fc7c expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.988373:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4ba00/0xd90bab03aefd85b6 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.988385:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4ba00/0xd90bab03aefd85b6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.988394:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4ba00/0xd90bab03aefd85b6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785944243.988449:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 7168 00000004:00200000:1.0:1785944243.988454:0:6466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 2 MDT count 2 00010000:00010000:1.0:1785944243.988492:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a000/0xd90bab03aefd85af lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc7c expref: 8 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.988507:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4ba00/0xd90bab03aefd85b6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc7c expref: 7 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944243.988516:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff967b89124900) 00010000:00010000:1.0:1785944243.988519:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785944243.988523:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967baee4ba00, rc 0) 00000100:00100000:1.0:1785944243.988596:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:12388:x1872697880509440:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 331us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944243.988604:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:1.0:1785944243.995300:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1785944243.995448:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880509696 00000100:00100000:2.0:1785944243.995457:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880509696 00000100:00100000:2.0:1785944243.995512:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:2.0:1785944243.995522:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8868c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+17:12388:x1872697880509696:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1785944243.995551:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785944243.995579:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c000/0xd90bab03aefd85bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fc83 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.995748:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809d600/0xd90bab03aefd85c4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.995762:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809d600/0xd90bab03aefd85c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.995772:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809d600/0xd90bab03aefd85c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785944243.995784:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x5:0x0]: returning size 1024 00010000:00010000:2.0:1785944243.996199:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c000/0xd90bab03aefd85bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc83 expref: 20 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.996215:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809d600/0xd90bab03aefd85c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc83 expref: 19 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944243.996238:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff967b922f1000) 00010000:00010000:2.0:1785944243.996240:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785944243.996243:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967b9809d600, rc 0) 00000100:00100000:2.0:1785944243.996296:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8868c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+19:12388:x1872697880509696:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 776us (1003us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1785944243.996302:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:2.0:1785944244.000121:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1785944244.000201:0:9903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880509952 00000100:00100000:1.0:1785944244.000209:0:9903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880509952 00000100:00100000:1.0:1785944244.000251:0:9903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:1.0:1785944244.000259:0:9903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfdfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:12388:x1872697880509952:12345-192.168.203.21@tcp:36:lfs.0 00000100:00100000:1.0:1785944244.000374:0:9903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a8868ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906834688:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785944244.000420:0:9903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944244.000451:0:9903:0:(client.c:2702:ptlrpc_set_wait()) set ffff967a88831d80 going to sleep for 11 seconds 00000100:00100000:2.0:1785944244.000500:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906834688 00000100:00100000:2.0:1785944244.000504:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906834688 00000100:00100000:2.0:1785944244.000537:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1785944244.000553:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8868e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:9903:x1872697906834688:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785944244.000649:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8868e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:9903:x1872697906834688:12345-0@lo:1000:mdt00_003.0 Request processed in 96us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944244.000656:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1785944244.000758:0:9903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a8868ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906834688:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785944244.000807:0:9903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a8868ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906834816:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785944244.000878:0:9903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944244.000897:0:9903:0:(client.c:2702:ptlrpc_set_wait()) set ffff967a88831d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785944244.001096:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906834816 00000100:00100000:3.0:1785944244.001101:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906834816 00000100:00100000:3.0:1785944244.001134:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1785944244.001141:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8868f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:9903:x1872697906834816:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785944244.001195:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8868f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:9903:x1872697906834816:12345-0@lo:1000:mdt00_003.0 Request processed in 53us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944244.001201:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1785944244.001227:0:9903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a8868ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906834816:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785944244.001264:0:9903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906834944:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785944244.001289:0:9903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944244.001303:0:9903:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840f780 going to sleep for 11 seconds 00000100:00100000:3.0:1785944244.001314:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906834944 00000100:00100000:3.0:1785944244.001318:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906834944 00000100:00100000:3.0:1785944244.001334:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1785944244.001340:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:9903:x1872697906834944:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785944244.001400:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:9903:x1872697906834944:12345-0@lo:1000:mdt00_003.0 Request processed in 59us (109us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785944244.001406:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1785944244.001428:0:9903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906834944:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1785944244.001470:0:9903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.001480:0:9903:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.001491:0:9903:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785944244.001510:0:9903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906835072:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1785944244.001533:0:9903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944244.001559:0:9903:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840f300 going to sleep for 11 seconds 00000100:00100000:3.0:1785944244.001579:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906835072 00000100:00100000:3.0:1785944244.001583:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906835072 00000100:00100000:3.0:1785944244.001600:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1785944244.001605:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:9903:x1872697906835072:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785944244.001614:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785944244.001627:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641a00/0xd90bab03aefd85d9 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd90bab03aefd85d2 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.001649:0:6471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3600/0xd90bab03aefd84eb lrc: 2/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.001658:0:6471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a400/0xd90bab03aefd8531 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc52 expref: 18 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.001667:0:6471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641a00/0xd90bab03aefd85d9 lrc: 5/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd90bab03aefd85d2 expref: 7 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.001689:0:6471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a400/0xd90bab03aefd8531 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc52 expref: 18 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.001702:0:6471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a400/0xd90bab03aefd8531 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc52 expref: 18 pid: 6466 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785944244.001713:0:6471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4ce00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6471:1872697906835200:192.168.203.21@tcp:104: 00010000:00010000:3.0:1785944244.001772:0:6471:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3600/0xd90bab03aefd84eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785944244.001820:0:6471:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840f780 going to sleep for 11 seconds 00000100:00100000:1.0:1785944244.014321:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1785944244.014365:0:6471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4ce00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6471:1872697906835200:192.168.203.21@tcp:104: 00010000:00010000:1.0:1785944244.014394:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641a00/0xd90bab03aefd85d9 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd85d2 expref: 7 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.014407:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff967b922f1700) 00010000:00010000:1.0:1785944244.014410:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785944244.014414:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641a00/0xd90bab03aefd85d9 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd85d2 expref: 7 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.014425:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967a89641a00, rc 0) 00000100:00100000:1.0:1785944244.014477:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:9903:x1872697906835072:12345-0@lo:101:mdt00_003.0 Request processed in 12871us (12943us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944244.014486:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1785944244.014529:0:9903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906835072:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1785944244.014553:0:9903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.014585:0:9903:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785944244.015183:0:9943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880510080 00000100:00100000:1.0:1785944244.015190:0:9943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880510080 00010000:00010000:1.0:1785944244.015213:0:9943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a400/0xd90bab03aefd8531 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc52 expref: 19 pid: 6466 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785944244.015237:0:9943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:1.0:1785944244.015244:0:9943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8868df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+19:2408:x1872697880510080:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785944244.015255:0:9943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785944244.015260:0:9943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a400/0xd90bab03aefd8531 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc52 expref: 19 pid: 6466 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.015270:0:9943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a400/0xd90bab03aefd8531 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc52 expref: 19 pid: 6466 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.015287:0:9943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a400/0xd90bab03aefd8531 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc52 expref: 19 pid: 6466 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.015298:0:9943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff967b922f1700) 00010000:00010000:1.0:1785944244.015303:0:9943:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641a00/0xd90bab03aefd85d9 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd85d2 expref: 6 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.015309:0:9943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785944244.015340:0:9943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8868df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+18:2408:x1872697880510080:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 97us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944244.015352:0:9943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 48 00010000:00010000:1.0:1785944244.041742:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3a00/0xd90bab03aefd8585 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd90bab03aefd858c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785944244.041761:0:6488:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3a00/0xd90bab03aefd8585 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd90bab03aefd858c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.041799:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3a00/0xd90bab03aefd8585 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd90bab03aefd858c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.041805:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785944244.041829:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff967bc0fa3a00/0xd90bab03aefd8585 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd90bab03aefd858c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785944244.041861:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967316 is committed 00010000:00010000:2.0:1785944244.041942:0:3460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd84dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.041951:0:3460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd84dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.041958:0:3460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd84dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.041963:0:3460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967a89641600 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:2.0:1785944244.041967:0:3460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd84dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042065:0:3460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd84dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042080:0:3460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf49c0507 (ffff967b84b00a00) 00010000:00010000:2.0:1785944244.042083:0:3460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944244.042087:0:3460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd84dd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042092:0:3460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd84dd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf49c0507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042107:0:3460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2200/0xd90bab03aefd84e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042113:0:3460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2200/0xd90bab03aefd84e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042117:0:3460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2200/0xd90bab03aefd84e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042121:0:3460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967bc0fa2200 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:2.0:1785944244.042124:0:3460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2200/0xd90bab03aefd84e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042129:0:3460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2200/0xd90bab03aefd84e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042134:0:3460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff967b922f1000) 00010000:00010000:2.0:1785944244.042136:0:3460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944244.042139:0:3460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2200/0xd90bab03aefd84e4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042152:0:3460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2200/0xd90bab03aefd84e4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042161:0:3460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3600/0xd90bab03aefd84eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042166:0:3460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3600/0xd90bab03aefd84eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042171:0:3460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3600/0xd90bab03aefd84eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042176:0:3460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967bc0fa3600 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:2.0:1785944244.042180:0:3460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3600/0xd90bab03aefd84eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042185:0:3460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3600/0xd90bab03aefd84eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042192:0:3460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff967b922f1700) 00010000:00010000:2.0:1785944244.042193:0:3460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944244.042199:0:3460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641a00/0xd90bab03aefd85d9 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd85d2 expref: 6 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042208:0:3460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641a00/0xd90bab03aefd85d9 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd90bab03aefd85d2 expref: 6 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042215:0:3460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641a00/0xd90bab03aefd85d9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd90bab03aefd85d2 expref: 6 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042247:0:3460:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641a00/0xd90bab03aefd85d9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd85d2 expref: 6 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785944244.042274:0:3460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a8869c380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3460:1872697906835456:0@lo:105: 00000100:00100000:2.0:1785944244.042327:0:3460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.042361:0:3460:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b88403840 going to sleep for 11 seconds 00000100:00100000:2.0:1785944244.042387:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906835456 00000100:00100000:2.0:1785944244.042393:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906835456 00000100:00100000:2.0:1785944244.042431:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1785944244.042438:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8869d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3460:x1872697906835456:12345-0@lo:105: 00010000:00010000:2.0:1785944244.042449:0:6448:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042457:0:6448:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042464:0:6448:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042470:0:6448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042476:0:6448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042485:0:6448:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042510:0:6448:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff967a89641c00) 00000100:00100000:2.0:1785944244.042552:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8869d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3460:x1872697906835456:12345-0@lo:105: Request processed in 114us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944244.042559:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1785944244.042676:0:3460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a8869c380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3460:1872697906835456:0@lo:105: 00010000:00010000:2.0:1785944244.042689:0:3460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3600/0xd90bab03aefd84eb lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042695:0:3460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3600/0xd90bab03aefd84eb lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042706:0:3460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c800/0xd90bab03aefd8593 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042711:0:3460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c800/0xd90bab03aefd8593 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042716:0:3460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c800/0xd90bab03aefd8593 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042720:0:3460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967b9809c800 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:2.0:1785944244.042723:0:3460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c800/0xd90bab03aefd8593 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042727:0:3460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c800/0xd90bab03aefd8593 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042735:0:3460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff967b8acf8e00) 00010000:00010000:2.0:1785944244.042736:0:3460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944244.042745:0:3460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c800/0xd90bab03aefd8593 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042750:0:3460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c800/0xd90bab03aefd8593 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042769:0:9903:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042776:0:9903:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785944244.042793:0:9903:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1785944244.042818:0:9903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd85e0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042824:0:9903:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd85e0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.042832:0:9903:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd85e0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785944244.042952:0:9903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a8869c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906835584:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1785944244.042977:0:9903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1785944244.043087:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967318 is committed 00000020:00080000:1.0:1785944244.043101:0:6488:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff967b8840f0c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1785944244.043104:0:6488:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff967bc0a5a900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff967b8840f180 00000020:00080000:1.0:1785944244.043107:0:6488:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].2 00000020:00080000:1.0:1785944244.043109:0:6488:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff967bc0a5ac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff967a818b3800 00000020:00080000:1.0:1785944244.043111:0:6488:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].2 00000100:00100000:1.0:1785944244.043124:0:3476:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785944244.043140:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a8868d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3476:1872697906835328:0@lo:103:tx_commit_cb.0 00000100:00100000:1.0:1785944244.043167:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944244.043197:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906835328 00000100:00100000:1.0:1785944244.043200:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906835328 00000100:00100000:1.0:1785944244.043228:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785944244.043240:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8868fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3476:x1872697906835328:12345-0@lo:103:tx_commit_cb.0 00010000:00010000:1.0:1785944244.043249:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785944244.043264:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640a00/0xd90bab03aefd858c lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd90bab03aefd8585 expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.043273:0:6451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8864fe66 (ffff967b84b00400) 00010000:00010000:1.0:1785944244.043279:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785944244.043303:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8868fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3476:x1872697906835328:12345-0@lo:103:tx_commit_cb.0 Request processed in 64us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944244.043308:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785944244.043333:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a8868d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3476:1872697906835328:0@lo:103:tx_commit_cb.0 00000100:00100000:2.0:1785944244.043424:0:9903:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b88403840 going to sleep for 11 seconds 00000100:00100000:2.0:1785944244.043437:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906835584 00000100:00100000:2.0:1785944244.043440:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906835584 00000100:00100000:2.0:1785944244.043468:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1785944244.043474:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8869c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:9903:x1872697906835584:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1785944244.043486:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785944244.043497:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd85e7 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd90bab03aefd85e0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.043518:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd85e7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd90bab03aefd85e0 expref: 8 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.043529:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd85e7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd85e0 expref: 8 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.043535:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x79085f7a (ffff967b8acf8500) 00010000:00010000:2.0:1785944244.043547:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944244.043550:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967b9809ca00, rc 0) 00000020:00080000:0.0:1785944244.043645:0:6499:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 1 00000020:00080000:0.0:1785944244.043867:0:6499:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1785944244.044260:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8869c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:9903:x1872697906835584:12345-0@lo:101:mdt00_003.0 Request processed in 785us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944244.044266:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1785944244.044360:0:9903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a8869c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906835584:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785944244.044379:0:9903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd85e0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd85e7 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.044389:0:9903:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd85e0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd85e7 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785944244.044402:0:9903:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1785944244.044444:0:9903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967b88cdf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906835712:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785944244.044469:0:9903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944244.044490:0:9903:0:(client.c:2702:ptlrpc_set_wait()) set ffff967ba2d1b840 going to sleep for 11 seconds 00000100:00100000:1.0:1785944244.044588:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906835712 00000100:00100000:1.0:1785944244.044593:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906835712 00000100:00100000:1.0:1785944244.044623:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1785944244.044632:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9903:x1872697906835712:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785944244.044796:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9903:x1872697906835712:12345-0@lo:1000:mdt00_003.0 Request processed in 165us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944244.044803:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1785944244.045147:0:9903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967b88cdf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906835712:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785944244.045190:0:9903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967b88cdf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906835840:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785944244.045213:0:9903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944244.045235:0:9903:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8983c540 going to sleep for 11 seconds 00000100:00100000:1.0:1785944244.045282:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906835840 00000100:00100000:1.0:1785944244.045286:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906835840 00000100:00100000:1.0:1785944244.045353:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1785944244.045360:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:9903:x1872697906835840:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785944244.045507:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:9903:x1872697906835840:12345-0@lo:1000:mdt00_003.0 Request processed in 146us (292us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785944244.045514:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1785944244.045582:0:9903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967b88cdf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906835840:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785944244.045649:0:9903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a8869ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906835968:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785944244.045676:0:9903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.046220:0:9903:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b88403840 going to sleep for 11 seconds 00000100:00100000:0.0:1785944244.046308:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906835968 00000100:00100000:0.0:1785944244.046313:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906835968 00000100:00100000:0.0:1785944244.046338:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1785944244.046344:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8869ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9903:x1872697906835968:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785944244.046505:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8869ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9903:x1872697906835968:12345-0@lo:1000:mdt00_003.0 Request processed in 159us (827us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785944244.046512:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1785944244.046664:0:9903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a8869ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906835968:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785944244.046712:0:9903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a8869ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906836096:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785944244.046734:0:9903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.046756:0:9903:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b884030c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785944244.046793:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906836096 00000100:00100000:0.0:1785944244.046798:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906836096 00000100:00100000:0.0:1785944244.046816:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1785944244.046821:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8869df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9903:x1872697906836096:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785944244.046910:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8869df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9903:x1872697906836096:12345-0@lo:1000:mdt00_003.0 Request processed in 88us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944244.046917:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1785944244.047122:0:9903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a8869ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906836096:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785944244.047161:0:9903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a8869ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906836224:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785944244.047184:0:9903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.047215:0:9903:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b884030c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785944244.047254:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906836224 00000100:00100000:0.0:1785944244.047259:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906836224 00000100:00100000:0.0:1785944244.047278:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1785944244.047284:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8869c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9903:x1872697906836224:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785944244.047340:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8869c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9903:x1872697906836224:12345-0@lo:1000:mdt00_003.0 Request processed in 56us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944244.047347:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1785944244.047450:0:9903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a8869ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906836224:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785944244.047485:0:9903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a8869ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906836352:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785944244.047506:0:9903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.047524:0:9903:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b884030c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785944244.047623:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906836352 00000100:00100000:0.0:1785944244.047627:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906836352 00000100:00100000:0.0:1785944244.047643:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1785944244.047649:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9903:x1872697906836352:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785944244.047704:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9903:x1872697906836352:12345-0@lo:1000:mdt00_003.0 Request processed in 55us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944244.047709:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1785944244.047764:0:9903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a8869ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9903:1872697906836352:0@lo:1000:mdt00_003.0 00000040:00080000:2.0:1785944244.048204:0:9903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785944244.048251:0:9903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].1, 64 off32832 00000004:00080000:2.0:1785944244.048259:0:9903:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff967b88403480 with version 2 00000040:00080000:2.0:1785944244.048311:0:9903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785944244.048322:0:9903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].2, 64 off32896 00000004:00080000:2.0:1785944244.048327:0:9903:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff967b88403cc0 with version 3 00000040:00080000:2.0:1785944244.049350:0:9903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785944244.049475:0:9903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].1, 64 off32832 00000040:00080000:2.0:1785944244.049602:0:9903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].1, 1080 off33848 00000040:00080000:2.0:1785944244.049721:0:9903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].1, 1224 off33992 00000004:00080000:2.0:1785944244.049727:0:9903:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff967b88403840 with version 4 00000004:00080000:0.0:1785944244.051291:0:7267:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff967b9195e840 version 2 rpc_version 2 00000020:00100000:0.0:1785944244.051326:0:7267:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785944244.051335:0:7267:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff967b88cde300 x1872697906836608/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785944244.051393:0:7267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967b88cde300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7267:1872697906836608:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785944244.051449:0:7267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944244.051481:0:7267:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b918c3840 going to sleep for 11 seconds 00000100:00100000:2.0:1785944244.051641:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906836608 00000100:00100000:2.0:1785944244.051647:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906836608 00000100:00100000:2.0:1785944244.051679:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1785944244.051686:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7267:x1872697906836608:12345-0@lo:1000:osp_up0-1.0 00000020:00080000:1.0:1785944244.087441:0:6488:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:0.0:1785944244.087489:0:6499:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 2 00000004:00080000:0.0:1785944244.087550:0:6499:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff967ba6d1c9c0 with version 8 00000020:00080000:0.0:1785944244.087576:0:6499:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 2 cancel update log [0x240000401:0x3:0x0].2: rc = 0 00000020:00080000:0.0:1785944244.087879:0:6499:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 2 cancel update log [0x200000400:0x3:0x0].2: rc = 0 00000020:00080000:0.0:1785944244.087889:0:6499:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 2 00000004:00080000:0.0:1785944244.087897:0:7460:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff967b96a216c0 version 8 rpc_version 8 00000020:00100000:0.0:1785944244.087924:0:7460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785944244.087934:0:7460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff967b88cdf480 x1872697906836864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785944244.087957:0:7460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967b88cdf480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7460:1872697906836864:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785944244.088038:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944244.088067:0:7460:0:(client.c:2702:ptlrpc_set_wait()) set ffff967ba6d1ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785944244.088087:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906836864 00000100:00100000:0.0:1785944244.088092:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906836864 00000100:00100000:0.0:1785944244.088127:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1785944244.088135:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7460:x1872697906836864:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785944244.088260:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7460:x1872697906836864:12345-0@lo:1000:osp_up1-0.0 Request processed in 124us (221us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1785944244.088267:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1785944244.088313:0:7460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967b88cdf480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7460:1872697906836864:0@lo:1000:osp_up1-0.0 00000001:00080000:1.0:1785944244.088685:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967319 is committed 00000100:00100000:2.0:1785944244.088804:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7267:x1872697906836608:12345-0@lo:1000:osp_up0-1.0 Request processed in 37117us (37353us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1785944244.088811:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000004:00080000:0.0:1785944244.088953:0:7267:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967319 committed transno 4294967319 00000100:00100000:0.0:1785944244.088957:0:7267:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967319 gen 2 00000100:00100000:0.0:1785944244.088970:0:7267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967b88cde300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7267:1872697906836608:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1785944244.089099:0:7267:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff967b9195e840 version 3 rpc_version 3 00000020:00100000:0.0:1785944244.089114:0:7267:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785944244.089119:0:7267:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff967b88cde300 x1872697906837120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785944244.089133:0:7267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967b88cde300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7267:1872697906837120:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785944244.089163:0:7267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944244.089218:0:7267:0:(client.c:2702:ptlrpc_set_wait()) set ffff967ba6d1ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785944244.089252:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906837120 00000100:00100000:1.0:1785944244.089256:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906837120 00000100:00100000:1.0:1785944244.089309:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1785944244.089316:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7267:x1872697906837120:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:3.0:1785944244.113758:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967320 is committed 00000100:00100000:2.0:1785944244.113915:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7267:x1872697906837120:12345-0@lo:1000:osp_up0-1.0 Request processed in 24594us (24745us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1785944244.113926:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000004:00080000:0.0:1785944244.114102:0:7267:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967320 committed transno 4294967320 00000100:00100000:0.0:1785944244.114107:0:7267:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967320 gen 2 00000100:00100000:0.0:1785944244.114123:0:7267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967b88cde300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7267:1872697906837120:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1785944244.114144:0:7267:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff967b9195e840 version 4 rpc_version 4 00000020:00100000:0.0:1785944244.114170:0:7267:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785944244.114178:0:7267:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff967b88cde300 x1872697906837376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785944244.114197:0:7267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967b88cde300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7267:1872697906837376:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785944244.114235:0:7267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944244.114267:0:7267:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b85728d80 going to sleep for 11 seconds 00000100:00100000:2.0:1785944244.114429:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906837376 00000100:00100000:2.0:1785944244.114435:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906837376 00000100:00100000:2.0:1785944244.114476:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1785944244.114484:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967baee09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7267:x1872697906837376:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785944244.115913:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967baee09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7267:x1872697906837376:12345-0@lo:1000:osp_up0-1.0 Request processed in 1427us (1674us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1785944244.115921:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1785944244.116150:0:7267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967b88cde300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7267:1872697906837376:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1785944244.116238:0:9903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff967b9809c800/0xd90bab03aefd85ee lrc: 3/0,1 mode: --/PW res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.116253:0:9903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967b9809c800/0xd90bab03aefd85ee lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.116263:0:9903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967b9809c800/0xd90bab03aefd85ee lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785944244.116278:0:9903:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033235f88 reply state 00000000a461bb20 transno 4294967308 ns: mdt-lustre-MDT0001_UUID lock: ffff967b9809c800/0xd90bab03aefd85ee lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.116288:0:9903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967b9809c800/0xd90bab03aefd85ee lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.116295:0:9903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff967b8acf8e00) 00010000:00010000:2.0:1785944244.116298:0:9903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785944244.116301:0:9903:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1785944244.116306:0:9903:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x2:0x0]: returning size 1024 00000004:00080000:2.0:1785944244.116312:0:9903:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1785944244.116322:0:9903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.116332:0:9903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.116341:0:9903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.116404:0:9903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1785944244.116410:0:9903:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1785944244.116415:0:9903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd85e0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd85e7 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.116423:0:9903:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd85e0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd85e7 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785944244.116499:0:9903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfdfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+9:12388:x1872697880509952:12345-192.168.203.21@tcp:36:lfs.0 Request processed in 116238us (116381us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1785944244.116506:0:9903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 64 00010000:00010000:1.0:1785944244.119893:0:7273:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785944244.119904:0:7273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.119914:0:7273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967a89641c00 already unused, calling callback (ffffffffc2226ee0) 00010000:00010000:1.0:1785944244.119919:0:7273:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785944244.119927:0:7273:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.119961:0:7273:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.119966:0:7273:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1785944244.120166:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a8868d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3476:1872697906837504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785944244.120214:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944244.120277:0:9882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906837504 00000100:00100000:3.0:1785944244.120283:0:9882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906837504 00000100:00100000:3.0:1785944244.120328:0:9882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785944244.120336:0:9882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3476:x1872697906837504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785944244.120346:0:9882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785944244.120362:0:9882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641a00/0xd90bab03aefd85d9 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd90bab03aefd85d2 expref: 9 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.120379:0:9882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff967b922f1700) 00010000:00010000:3.0:1785944244.120389:0:9882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785944244.120475:0:7273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.120484:0:7273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641c00/0xd90bab03aefd85d2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd90bab03aefd85d9 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.120500:0:7273:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785944244.120502:0:7273:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785944244.120503:0:7273:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785944244.122254:0:9882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3476:x1872697906837504:12345-0@lo:103:ldlm_bl.0 Request processed in 1915us (2036us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944244.122263:0:9882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785944244.122801:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944244.122880:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880510208 00000100:00100000:3.0:1785944244.122886:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880510208 00000100:00100000:3.0:1785944244.122920:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:3.0:1785944244.122927:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8868ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+9:12230:x1872697880510208:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1785944244.122944:0:10054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785944244.122959:0:10054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640c00/0xd90bab03aefd85f5 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fc8a expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.123036:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641400/0xd90bab03aefd85fc lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.123048:0:10054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641400/0xd90bab03aefd85fc lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.123056:0:10054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641400/0xd90bab03aefd85fc lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.123068:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641e00/0xd90bab03aefd8603 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.123074:0:10054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641e00/0xd90bab03aefd8603 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.123079:0:10054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641e00/0xd90bab03aefd8603 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785944244.123175:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10054:1872697906837632:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1785944244.123207:0:10054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944244.123229:0:10054:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840f780 going to sleep for 11 seconds 00000100:00100000:1.0:1785944244.123360:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906837632 00000100:00100000:1.0:1785944244.123364:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906837632 00000100:00100000:1.0:1785944244.123388:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1785944244.123395:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:10054:x1872697906837632:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785944244.123703:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:10054:x1872697906837632:12345-0@lo:1000:mdt00_004.0 Request processed in 307us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944244.123710:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1785944244.124089:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10054:1872697906837632:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1785944244.124123:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640400/0xd90bab03aefd860a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124132:0:10054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640400/0xd90bab03aefd860a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124139:0:10054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640400/0xd90bab03aefd860a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785944244.124168:0:10054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640400/0xd90bab03aefd860a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124179:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641400/0xd90bab03aefd85fc lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124186:0:10054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641400/0xd90bab03aefd85fc lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124192:0:10054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641400/0xd90bab03aefd85fc lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124198:0:10054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967a89641400 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:3.0:1785944244.124202:0:10054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641400/0xd90bab03aefd85fc lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124207:0:10054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641400/0xd90bab03aefd85fc lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124217:0:10054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff967b89124900) 00010000:00010000:3.0:1785944244.124220:0:10054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785944244.124223:0:10054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641400/0xd90bab03aefd85fc lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124229:0:10054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641400/0xd90bab03aefd85fc lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124239:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641e00/0xd90bab03aefd8603 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124244:0:10054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641e00/0xd90bab03aefd8603 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124256:0:10054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641e00/0xd90bab03aefd8603 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124261:0:10054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967a89641e00 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:3.0:1785944244.124264:0:10054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641e00/0xd90bab03aefd8603 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124270:0:10054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641e00/0xd90bab03aefd8603 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124279:0:10054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8864fe66 (ffff967b84b00200) 00010000:00010000:3.0:1785944244.124281:0:10054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785944244.124283:0:10054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641e00/0xd90bab03aefd8603 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124289:0:10054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641e00/0xd90bab03aefd8603 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8864fe66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124320:0:10054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640c00/0xd90bab03aefd85f5 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc8a expref: 11 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124332:0:10054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640400/0xd90bab03aefd860a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc8a expref: 10 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.124338:0:10054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff967b84b00f00) 00010000:00010000:3.0:1785944244.124340:0:10054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785944244.124342:0:10054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967a89640400, rc 0) 00000100:00100000:3.0:1785944244.124386:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8868ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+10:12230:x1872697880510208:12345-192.168.203.21@tcp:101:bash.0 Request processed in 1459us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944244.124413:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:2.0:1785944244.127306:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a8868d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3476:1872697906837504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785944244.128404:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1785944244.128473:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880510336 00000100:00100000:2.0:1785944244.128480:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880510336 00000100:00100000:2.0:1785944244.128568:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 66 00000100:00100000:2.0:1785944244.128578:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc04a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+11:12230:x1872697880510336:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1785944244.128598:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785944244.128615:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809de00/0xd90bab03aefd8611 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fc91 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.128663:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809cc00/0xd90bab03aefd8618 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.128674:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809cc00/0xd90bab03aefd8618 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.128693:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809cc00/0xd90bab03aefd8618 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785944244.128891:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x6:0x0]: returning size 7168 00000004:00200000:2.0:1785944244.128894:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 2 00010000:00010000:2.0:1785944244.128977:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809de00/0xd90bab03aefd8611 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc91 expref: 13 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.129222:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809cc00/0xd90bab03aefd8618 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc91 expref: 12 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.129231:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff967b8acf8100) 00010000:00010000:2.0:1785944244.129234:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1785944244.129236:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967b9809cc00, rc 0) 00000100:00100000:1.0:1785944244.129665:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc04a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+12:12230:x1872697880510336:12345-192.168.203.21@tcp:101:bash.0 Request processed in 1087us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944244.129672:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 66 00000100:00100000:2.0:1785944244.135257:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944244.135330:0:9903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880510592 00000100:00100000:0.0:1785944244.135337:0:9903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880510592 00000100:00100000:0.0:1785944244.135412:0:9903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 67 00000100:00100000:0.0:1785944244.135423:0:9903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+12:12230:x1872697880510592:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:0.0:1785944244.135443:0:9903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785944244.135463:0:9903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd861f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fc98 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.135744:0:9903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8626 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.135759:0:9903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8626 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.135778:0:9903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8626 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.135790:0:9903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2a00/0xd90bab03aefd862d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.135796:0:9903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2a00/0xd90bab03aefd862d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.135801:0:9903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2a00/0xd90bab03aefd862d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785944244.136793:0:9903:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1785944244.137330:0:9903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3200/0xd90bab03aefd8634 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.137341:0:9903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3200/0xd90bab03aefd8634 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.137350:0:9903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3200/0xd90bab03aefd8634 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.137380:0:9903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8626 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.137386:0:9903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8626 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.137392:0:9903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8626 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.137398:0:9903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8626 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.137410:0:9903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967bc0fa3c00 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:0.0:1785944244.137414:0:9903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8626 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.137421:0:9903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8626 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.137433:0:9903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff967b8acf8100) 00010000:00010000:0.0:1785944244.137436:0:9903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785944244.137441:0:9903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8626 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.137447:0:9903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8626 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785944244.137460:0:9903:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f797b164 reply state 00000000f6b60da0 transno 4294967322 ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2a00/0xd90bab03aefd862d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.137471:0:9903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2a00/0xd90bab03aefd862d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.137477:0:9903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x1c2f8c79 (ffff967b922f1900) 00010000:00010000:0.0:1785944244.137479:0:9903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785944244.137482:0:9903:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785944244.137510:0:9903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd861f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc98 expref: 15 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.137524:0:9903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3200/0xd90bab03aefd8634 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc98 expref: 14 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.137554:0:9903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff967b922f1400) 00010000:00010000:0.0:1785944244.137556:0:9903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785944244.137683:0:9903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967bc0fa3200, rc 0) 00000100:00100000:0.0:1785944244.137791:0:9903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+15:12230:x1872697880510592:12345-192.168.203.21@tcp:101:bash.0 Request processed in 2369us (2540us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1785944244.137798:0:9903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 67 00000100:00100000:0.0:1785944244.143799:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1785944244.144128:0:8336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880510720 00000100:00100000:2.0:1785944244.144136:0:8336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880510720 00000100:00080000:1.0:1785944244.144243:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785944244.144277:0:8336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:2.0:1785944244.144287:0:8336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a895a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+5:12230:x1872697880510720:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1785944244.144302:0:8336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785944244.144321:0:8336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8a6e2d8/0xd90bab03aefd8642 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fc9f expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785944244.144342:0:8336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785944244.144360:0:8336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1785944244.144364:0:8336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785944244.144373:0:8336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8a6e2d8/0xd90bab03aefd8642 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc9f expref: 6 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.144403:0:8336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8a6e2d8/0xd90bab03aefd8642 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc9f expref: 6 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.144416:0:8336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967b9809de00, rc 0) 00000100:00100000:2.0:1785944244.144471:0:8336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a895a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+6:12230:x1872697880510720:12345-192.168.203.21@tcp:101:bash.0 Request processed in 185us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944244.144478:0:8336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:1.0:1785944244.148640:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1785944244.148742:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880510976 00000100:00100000:2.0:1785944244.148749:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880510976 00000100:00100000:2.0:1785944244.148792:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:2.0:1785944244.148800:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8868d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+15:12230:x1872697880510976:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:2.0:1785944244.149278:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8868d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+16:12230:x1872697880510976:12345-192.168.203.21@tcp:35:bash.0 Request processed in 477us (645us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1785944244.149284:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:3.0:1785944244.152445:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944244.152535:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880511104 00000100:00100000:0.0:1785944244.152550:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880511104 00000100:00100000:0.0:1785944244.152609:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:0.0:1785944244.152617:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+16:12230:x1872697880511104:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:0.0:1785944244.152637:0:10054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785944244.152657:0:10054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8649 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fca6 expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.152706:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8650 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.152718:0:10054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8650 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.152727:0:10054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8650 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.152737:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8657 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.152747:0:10054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd85e7 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd85e0 expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.152767:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8657 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.152796:0:10054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd85e7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd90bab03aefd85e0 expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785944244.152820:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a895a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10054:1872697906837760:0@lo:104: 00000100:00100000:0.0:1785944244.152896:0:10054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944244.152924:0:10054:0:(client.c:2702:ptlrpc_set_wait()) set ffff967ba6d1cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1785944244.153150:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906837760 00000100:00100000:2.0:1785944244.153155:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906837760 00000100:00100000:2.0:1785944244.153192:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1785944244.153200:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfd60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:10054:x1872697906837760:12345-0@lo:104: 00010000:00010000:2.0:1785944244.153211:0:8114:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd85e0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd90bab03aefd85e7 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.153267:0:8114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785944244.153272:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfd60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:10054:x1872697906837760:12345-0@lo:104: Request processed in 74us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944244.153278:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:0.0:1785944244.153461:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785944244.153468:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd85e0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd90bab03aefd85e7 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.153476:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967b9809c600 already unused, calling callback (ffffffffc2226ee0) 00010000:00010000:0.0:1785944244.153482:0:6453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd85e0 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd90bab03aefd85e7 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785944244.153491:0:6453:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd85e0 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd90bab03aefd85e7 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.153517:0:6453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd85e0 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd90bab03aefd85e7 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.153524:0:6453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785944244.153556:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd85e0 lrc: 1/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd90bab03aefd85e7 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.153565:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd85e0 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd90bab03aefd85e7 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.153591:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785944244.153594:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785944244.153595:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785944244.153623:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a895a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10054:1872697906837760:0@lo:104: 00010000:00010000:0.0:1785944244.153638:0:10054:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8657 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785944244.153693:0:3473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfd61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3473:1872697906837888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785944244.153726:0:3473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944244.153798:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906837888 00000100:00100000:1.0:1785944244.153803:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906837888 00010000:00010000:1.0:1785944244.153831:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd85e7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd90bab03aefd85e0 expref: 8 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785944244.153890:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1785944244.153897:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b98bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3473:x1872697906837888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785944244.153906:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1785944244.189316:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967322 is committed 00000001:00080000:3.0:1785944244.189332:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967323 is committed 00000001:00080000:3.0:1785944244.189338:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967321 is committed 00010000:00010000:2.0:1785944244.191767:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2a00/0xd90bab03aefd862d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.191782:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2a00/0xd90bab03aefd862d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.191790:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2a00/0xd90bab03aefd862d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.191797:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967bc0fa2a00 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:2.0:1785944244.191802:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2a00/0xd90bab03aefd862d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.191810:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2a00/0xd90bab03aefd862d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.191825:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x1c2f8c79 (ffff967b922f1900) 00010000:00010000:2.0:1785944244.191828:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944244.191832:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2a00/0xd90bab03aefd862d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.191839:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2a00/0xd90bab03aefd862d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.196635:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd85e7 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd90bab03aefd85e0 expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.196656:0:6450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x79085f7a (ffff967b8acf8500) 00010000:00010000:1.0:1785944244.196660:0:6450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8657 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.196686:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8657 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.196693:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8657 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.196727:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785944244.196809:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b98bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3473:x1872697906837888:12345-0@lo:103:ldlm_bl.0 Request processed in 42910us (43080us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944244.196818:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1785944244.197051:0:3473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfd61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3473:1872697906837888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785944244.197141:0:10054:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8657 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.197149:0:10054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8657 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785944244.197402:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10054:1872697906838016:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1785944244.197435:0:10054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944244.197462:0:10054:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840f180 going to sleep for 11 seconds 00000100:00100000:2.0:1785944244.197553:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906838016 00000100:00100000:2.0:1785944244.197566:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906838016 00000100:00100000:2.0:1785944244.197603:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1785944244.197611:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:10054:x1872697906838016:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785944244.197712:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:10054:x1872697906838016:12345-0@lo:1000:mdt00_004.0 Request processed in 101us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944244.197726:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1785944244.197839:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10054:1872697906838016:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1785944244.197905:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a000/0xd90bab03aefd865e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.197915:0:10054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a000/0xd90bab03aefd865e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.197922:0:10054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a000/0xd90bab03aefd865e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785944244.197940:0:10054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a000/0xd90bab03aefd865e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.197950:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8650 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.197955:0:10054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8650 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.197961:0:10054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8650 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.197972:0:10054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967bc0fa2800 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:1.0:1785944244.197976:0:10054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8650 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.197982:0:10054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8650 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.197998:0:10054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff967b922f1c00) 00010000:00010000:1.0:1785944244.198001:0:10054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785944244.198005:0:10054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8650 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.198010:0:10054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2800/0xd90bab03aefd8650 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.198020:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8657 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.198025:0:10054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8657 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.198030:0:10054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8657 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.198034:0:10054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967bc0fa2600 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:1.0:1785944244.198036:0:10054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8657 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.198041:0:10054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8657 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.198056:0:10054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x79085f7a (ffff967b8acf8500) 00010000:00010000:1.0:1785944244.198058:0:10054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785944244.198060:0:10054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8657 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.198065:0:10054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa2600/0xd90bab03aefd8657 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x79085f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.198096:0:10054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3c00/0xd90bab03aefd8649 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fca6 expref: 15 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.198109:0:10054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967baee4a000/0xd90bab03aefd865e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fca6 expref: 14 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.198115:0:10054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff967b89124e00) 00010000:00010000:1.0:1785944244.198117:0:10054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785944244.198119:0:10054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967baee4a000, rc 0) 00000100:00100000:1.0:1785944244.198175:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+14:12230:x1872697880511104:12345-192.168.203.21@tcp:101:bash.0 Request processed in 45559us (45737us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944244.198181:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:1.0:1785944244.201486:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944244.201696:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880511232 00000100:00100000:3.0:1785944244.201704:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880511232 00000100:00100000:3.0:1785944244.201756:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:3.0:1785944244.201765:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8868df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+10:12230:x1872697880511232:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1785944244.201784:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785944244.201802:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640c00/0xd90bab03aefd8665 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fcad expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.201893:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641e00/0xd90bab03aefd866c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.201906:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641e00/0xd90bab03aefd866c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.201926:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641e00/0xd90bab03aefd866c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785944244.201976:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x2:0x0]: returning size 1024 00000004:00200000:3.0:1785944244.201979:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 2 00010000:00010000:3.0:1785944244.202073:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640c00/0xd90bab03aefd8665 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fcad expref: 12 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.202090:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641e00/0xd90bab03aefd866c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fcad expref: 11 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.202098:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff967b8acf8e00) 00010000:00010000:3.0:1785944244.202101:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1785944244.202104:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967a89641e00, rc 0) 00000100:00100000:3.0:1785944244.202154:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8868df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+11:12230:x1872697880511232:12345-192.168.203.21@tcp:101:bash.0 Request processed in 390us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944244.202162:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:2.0:1785944244.205922:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944244.206103:0:9903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880511488 00000100:00100000:3.0:1785944244.206111:0:9903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880511488 00000100:00100000:3.0:1785944244.206156:0:9903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00100000:3.0:1785944244.206164:0:9903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+11:12230:x1872697880511488:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1785944244.206182:0:9903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785944244.206198:0:9903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641400/0xd90bab03aefd8673 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fcb4 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.206307:0:9903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641a00/0xd90bab03aefd867a lrc: 3/0,1 mode: --/CW res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.206333:0:9903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641a00/0xd90bab03aefd867a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.206342:0:9903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641a00/0xd90bab03aefd867a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.206356:0:9903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641000/0xd90bab03aefd8681 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x2:0x0].0x4aadbd0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.206362:0:9903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641000/0xd90bab03aefd8681 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x4aadbd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.206367:0:9903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641000/0xd90bab03aefd8681 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x4aadbd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785944244.207324:0:9903:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1785944244.207475:0:9903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640200/0xd90bab03aefd8688 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.207486:0:9903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640200/0xd90bab03aefd8688 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.207495:0:9903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640200/0xd90bab03aefd8688 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.207545:0:9903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641a00/0xd90bab03aefd867a lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.207552:0:9903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641a00/0xd90bab03aefd867a lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.207557:0:9903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641a00/0xd90bab03aefd867a lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.207761:0:9903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641a00/0xd90bab03aefd867a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.207766:0:9903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967a89641a00 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:3.0:1785944244.207770:0:9903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641a00/0xd90bab03aefd867a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.207777:0:9903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641a00/0xd90bab03aefd867a lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.207787:0:9903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff967b8acf8e00) 00010000:00010000:3.0:1785944244.207790:0:9903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785944244.207795:0:9903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641a00/0xd90bab03aefd867a lrc: 3/0,0 mode: --/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.207800:0:9903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641a00/0xd90bab03aefd867a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785944244.207812:0:9903:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022852d61 reply state 00000000130b5799 transno 4294967310 ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641000/0xd90bab03aefd8681 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x4aadbd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.207822:0:9903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641000/0xd90bab03aefd8681 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x4aadbd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9903 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.207827:0:9903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x4aadbd0b (ffff967b84b00200) 00010000:00010000:3.0:1785944244.207829:0:9903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785944244.207831:0:9903:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785944244.208055:0:9903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641400/0xd90bab03aefd8673 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fcb4 expref: 14 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.208069:0:9903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640200/0xd90bab03aefd8688 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fcb4 expref: 13 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.208081:0:9903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff967b84b00b00) 00010000:00010000:3.0:1785944244.208083:0:9903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785944244.208086:0:9903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967a89640200, rc 0) 00000100:00100000:3.0:1785944244.208156:0:9903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+14:12230:x1872697880511488:12345-192.168.203.21@tcp:101:bash.0 Request processed in 1992us (2241us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1785944244.208163:0:9903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00100000:1.0:1785944244.214012:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944244.214124:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880511616 00000100:00100000:0.0:1785944244.214132:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880511616 00000100:00100000:0.0:1785944244.214183:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:0.0:1785944244.214192:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8868fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+6:12230:x1872697880511616:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:0.0:1785944244.214208:0:8098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785944244.214225:0:8098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cf1fbdd/0xd90bab03aefd8696 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fcbb expref: -99 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785944244.214247:0:8098:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785944244.214265:0:8098:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1785944244.214268:0:8098:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785944244.214276:0:8098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cf1fbdd/0xd90bab03aefd8696 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fcbb expref: 7 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.214288:0:8098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008cf1fbdd/0xd90bab03aefd8696 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fcbb expref: 7 pid: 8098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785944244.214300:0:8098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967bc0fa3000, rc 0) 00000100:00100000:0.0:1785944244.214365:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8868fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:12230:x1872697880511616:12345-192.168.203.21@tcp:101:bash.0 Request processed in 173us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944244.214385:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:1.0:1785944244.218579:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1785944244.218681:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880511872 00000100:00100000:2.0:1785944244.218688:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880511872 00000100:00100000:2.0:1785944244.218733:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:2.0:1785944244.218741:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbb230850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+14:12230:x1872697880511872:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:2.0:1785944244.219083:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbb230850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+15:12230:x1872697880511872:12345-192.168.203.21@tcp:35:bash.0 Request processed in 342us (509us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1785944244.219090:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:2.0:1785944244.289234:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1785944244.289334:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880512000 00000100:00100000:1.0:1785944244.289343:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880512000 00000100:00100000:1.0:1785944244.289398:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00100000:1.0:1785944244.289409:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+15:12394:x1872697880512000:12345-192.168.203.21@tcp:101:renameat2.0 00010000:00010000:1.0:1785944244.289448:0:10054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785944244.289467:0:10054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b000/0xd90bab03aefd869d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fcc2 expref: -99 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289544:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd86a4 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289557:0:10054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd86a4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289573:0:10054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd86a4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289587:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd86ab lrc: 3/1,0 mode: --/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289595:0:10054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd86ab lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289601:0:10054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd86ab lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289654:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd86a4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289660:0:10054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd86a4 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289667:0:10054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd86a4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289674:0:10054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967baee4a200 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:1.0:1785944244.289682:0:10054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd86a4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289690:0:10054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd86a4 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289702:0:10054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff967b8acf8e00) 00010000:00010000:1.0:1785944244.289705:0:10054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785944244.289709:0:10054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd86a4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289715:0:10054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4a200/0xd90bab03aefd86a4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289729:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd86ab lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289734:0:10054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd86ab lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289740:0:10054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd86ab lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289746:0:10054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967baee4b800 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:1.0:1785944244.289748:0:10054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd86ab lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289754:0:10054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd86ab lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289760:0:10054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0xd04803f8 (ffff967b89124800) 00010000:00010000:1.0:1785944244.289762:0:10054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785944244.289768:0:10054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd86ab lrc: 2/0,0 mode: --/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289774:0:10054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b800/0xd90bab03aefd86ab lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10054 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289814:0:10054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b000/0xd90bab03aefd869d lrc: 1/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fcc2 expref: 16 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289824:0:10054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff967b8acf8e00) 00010000:00010000:1.0:1785944244.289826:0:10054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785944244.289830:0:10054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967baee4b000/0xd90bab03aefd869d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fcc2 expref: 16 pid: 10054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.289839:0:10054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967baee4b000, rc 0) 00000100:00100000:1.0:1785944244.289945:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+15:12394:x1872697880512000:12345-192.168.203.21@tcp:101:renameat2.0 Request processed in 538us (719us total) trans 0 rc 301/301 00000100:00100000:1.0:1785944244.289952:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00100000:3.0:1785944244.295618:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1785944244.295742:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880512128 00000100:00100000:1.0:1785944244.295751:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880512128 00000100:00100000:1.0:1785944244.295826:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:1.0:1785944244.295836:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+14:2407:x1872697880512128:12345-192.168.203.21@tcp:103:renameat2.0 00010000:00010000:1.0:1785944244.295883:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785944244.295903:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967bc0fa3200/0xd90bab03aefd8634 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fc98 expref: 14 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.295919:0:6452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff967b922f1400) 00010000:00010000:1.0:1785944244.295927:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785944244.295978:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+13:2407:x1872697880512128:12345-192.168.203.21@tcp:103:renameat2.0 Request processed in 144us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944244.296141:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:0.0:1785944244.296918:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944244.297100:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880512384 00000100:00100000:3.0:1785944244.297105:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880512384 00000100:00100000:3.0:1785944244.297144:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:3.0:1785944244.297151:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfd61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+15:12394:x1872697880512384:12345-192.168.203.21@tcp:36:renameat2.0 00000100:00100000:3.0:1785944244.297254:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906838144:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.297296:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944244.297319:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785944244.297407:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906838144 00000100:00100000:1.0:1785944244.297412:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906838144 00000100:00100000:1.0:1785944244.297437:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1785944244.297444:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6478:x1872697906838144:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785944244.297532:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6478:x1872697906838144:12345-0@lo:1000:mdt_io00_000.0 Request processed in 87us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944244.297549:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1785944244.297670:0:6478:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1785944244.297677:0:6478:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967321 committed transno 4294967321 00000100:00100000:3.0:1785944244.297716:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906838144:0@lo:1000:mdt_io00_000.0 00000004:00080000:3.0:1785944244.297739:0:6478:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x6:0x0] 00000100:00100000:3.0:1785944244.297790:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906838272:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.297826:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944244.297861:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785944244.297886:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906838272 00000100:00100000:3.0:1785944244.297889:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906838272 00000100:00100000:3.0:1785944244.297907:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1785944244.297913:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6478:x1872697906838272:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.298291:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6478:x1872697906838272:12345-0@lo:1000:mdt_io00_000.0 Request processed in 377us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944244.298298:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1785944244.298325:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906838272:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.298358:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba6d4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906838400:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.298380:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944244.298394:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785944244.298405:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906838400 00000100:00100000:3.0:1785944244.298408:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906838400 00000100:00100000:3.0:1785944244.298422:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1785944244.298427:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6478:x1872697906838400:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.298488:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6478:x1872697906838400:12345-0@lo:1000:mdt_io00_000.0 Request processed in 60us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944244.298494:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1785944244.298512:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba6d4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906838400:0@lo:1000:mdt_io00_000.0 00000004:00080000:3.0:1785944244.298526:0:6478:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x5:0x0] 00000100:00100000:3.0:1785944244.298706:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0d2c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906838528:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.298729:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944244.298778:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785944244.300170:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906838528 00000100:00100000:2.0:1785944244.300176:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906838528 00000100:00100000:2.0:1785944244.300234:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1785944244.300241:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6478:x1872697906838528:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785944244.300303:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6478:x1872697906838528:12345-0@lo:1000:mdt_io00_000.0 Request processed in 63us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944244.300309:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1785944244.300368:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0d2c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906838528:0@lo:1000:mdt_io00_000.0 00010000:00010000:3.0:1785944244.300419:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641400/0xd90bab03aefd86b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.300428:0:6478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641400/0xd90bab03aefd86b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.300446:0:6478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641400/0xd90bab03aefd86b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785944244.300459:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0d2c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906838656:0@lo:101:mdt_io00_000.0 00000100:00100000:3.0:1785944244.300480:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944244.300500:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840f300 going to sleep for 11 seconds 00000100:00100000:2.0:1785944244.300629:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906838656 00000100:00100000:2.0:1785944244.300634:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906838656 00000100:00100000:2.0:1785944244.300651:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1785944244.300657:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6478:x1872697906838656:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1785944244.300666:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785944244.300679:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c000/0xd90bab03aefd86b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd90bab03aefd86b2 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.300701:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c000/0xd90bab03aefd86b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd90bab03aefd86b2 expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.300722:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c000/0xd90bab03aefd86b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd86b2 expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.300730:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff967b8acf8100) 00010000:00010000:2.0:1785944244.300732:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944244.300735:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967b9809c000, rc 0) 00000100:00100000:2.0:1785944244.300774:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6478:x1872697906838656:12345-0@lo:101:mdt_io00_000.0 Request processed in 116us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944244.300780:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1785944244.301159:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0d2c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906838656:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785944244.301171:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641400/0xd90bab03aefd86b2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd86b9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.301181:0:6478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641400/0xd90bab03aefd86b2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd86b9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785944244.301194:0:6478:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x6:0x0] 00010000:00010000:3.0:1785944244.301213:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641a00/0xd90bab03aefd86c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.301219:0:6478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641a00/0xd90bab03aefd86c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.301226:0:6478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641a00/0xd90bab03aefd86c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785944244.301238:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0d2c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906838784:0@lo:101:mdt_io00_000.0 00000100:00100000:3.0:1785944244.301261:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944244.301284:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840f300 going to sleep for 11 seconds 00000100:00100000:2.0:1785944244.301334:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906838784 00000100:00100000:2.0:1785944244.301339:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906838784 00000100:00100000:2.0:1785944244.301369:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1785944244.301376:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6478:x1872697906838784:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1785944244.301384:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785944244.301395:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd86c7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd90bab03aefd86c0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.301410:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd86c7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd90bab03aefd86c0 expref: 8 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.301420:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd86c7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd86c0 expref: 8 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.301427:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x1c2f8c79 (ffff967b8acf8f00) 00010000:00010000:2.0:1785944244.301429:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944244.301432:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967b9809ca00, rc 0) 00000100:00100000:2.0:1785944244.301557:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6478:x1872697906838784:12345-0@lo:101:mdt_io00_000.0 Request processed in 180us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944244.301573:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1785944244.301781:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0d2c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906838784:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785944244.301792:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641a00/0xd90bab03aefd86c0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd86c7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.301810:0:6478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641a00/0xd90bab03aefd86c0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd86c7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785944244.301822:0:6478:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x6:0x0] 00010000:00010000:3.0:1785944244.301835:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640c00/0xd90bab03aefd86ce lrc: 3/0,1 mode: --/CW res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.303193:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640c00/0xd90bab03aefd86ce lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.303207:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640c00/0xd90bab03aefd86ce lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.303240:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640600/0xd90bab03aefd86d5 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.303249:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640600/0xd90bab03aefd86d5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.303256:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640600/0xd90bab03aefd86d5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785944244.303300:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0d2c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906838912:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.303335:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944244.303362:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785944244.303426:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906838912 00000100:00100000:0.0:1785944244.303431:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906838912 00000100:00100000:0.0:1785944244.303470:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1785944244.303479:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6478:x1872697906838912:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785944244.303839:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6478:x1872697906838912:12345-0@lo:1000:mdt_io00_000.0 Request processed in 359us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944244.303880:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1785944244.304224:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0d2c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906838912:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.304267:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0d2c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839040:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.304291:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944244.304349:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785944244.304386:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906839040 00000100:00100000:1.0:1785944244.304390:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906839040 00000100:00100000:1.0:1785944244.304455:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1785944244.304463:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba6d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6478:x1872697906839040:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785944244.304531:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba6d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6478:x1872697906839040:12345-0@lo:1000:mdt_io00_000.0 Request processed in 69us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944244.304547:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1785944244.304605:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0d2c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839040:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785944244.304643:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839168:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785944244.304668:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.304884:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b88403840 going to sleep for 11 seconds 00000100:00100000:3.0:1785944244.305122:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906839168 00000100:00100000:3.0:1785944244.305127:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906839168 00000100:00100000:3.0:1785944244.305148:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1785944244.305154:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6478:x1872697906839168:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.305388:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6478:x1872697906839168:12345-0@lo:1000:mdt_io00_000.0 Request processed in 233us (718us total) trans 0 rc 1/1 00000100:00100000:3.0:1785944244.305395:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1785944244.305460:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839168:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785944244.305526:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839296:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785944244.305653:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.305677:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b88403180 going to sleep for 11 seconds 00000100:00100000:3.0:1785944244.305727:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906839296 00000100:00100000:3.0:1785944244.305731:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906839296 00000100:00100000:3.0:1785944244.305750:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1785944244.305756:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6478:x1872697906839296:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.305808:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6478:x1872697906839296:12345-0@lo:1000:mdt_io00_000.0 Request processed in 52us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944244.305814:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1785944244.305887:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839296:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785944244.305947:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839424:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785944244.305971:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.306141:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b88403180 going to sleep for 11 seconds 00000100:00100000:1.0:1785944244.306205:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906839424 00000100:00100000:1.0:1785944244.306209:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906839424 00000100:00100000:0.0:1785944244.306276:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1785944244.306283:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8869ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6478:x1872697906839424:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785944244.306332:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8869ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6478:x1872697906839424:12345-0@lo:1000:mdt_io00_000.0 Request processed in 51us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944244.306338:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1785944244.306385:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839424:0@lo:1000:mdt_io00_000.0 00000004:00080000:2.0:1785944244.306402:0:6478:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:2.0:1785944244.306427:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839552:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785944244.306450:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.306699:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b88403180 going to sleep for 11 seconds 00000100:00100000:3.0:1785944244.306743:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906839552 00000100:00100000:3.0:1785944244.306746:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906839552 00000100:00100000:3.0:1785944244.306763:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1785944244.306768:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a88eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6478:x1872697906839552:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.306825:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a88eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6478:x1872697906839552:12345-0@lo:1000:mdt_io00_000.0 Request processed in 56us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944244.306832:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1785944244.306953:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839552:0@lo:1000:mdt_io00_000.0 00000004:00080000:2.0:1785944244.306968:0:6478:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x5:0x0] 00010000:00010000:2.0:1785944244.307033:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd86dc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.307052:0:6478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd86dc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.307062:0:6478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd86dc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785944244.307073:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a88eed500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839680:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1785944244.307094:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.307113:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b88403840 going to sleep for 11 seconds 00000100:00100000:3.0:1785944244.307196:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906839680 00000100:00100000:3.0:1785944244.307200:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906839680 00000100:00100000:3.0:1785944244.307216:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1785944244.307221:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a88eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6478:x1872697906839680:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785944244.307229:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785944244.307246:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641c00/0xd90bab03aefd86e3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd90bab03aefd86dc expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.307266:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641c00/0xd90bab03aefd86e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd90bab03aefd86dc expref: 9 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.307277:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641c00/0xd90bab03aefd86e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd86dc expref: 9 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.307286:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff967b84b00e00) 00010000:00010000:3.0:1785944244.307289:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1785944244.307292:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967a89641c00, rc 0) 00000100:00100000:3.0:1785944244.307346:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a88eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6478:x1872697906839680:12345-0@lo:101:mdt_io00_000.0 Request processed in 125us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944244.307352:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1785944244.307450:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a88eed500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839680:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1785944244.307463:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd86dc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd86e3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.307473:0:6478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd86dc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd86e3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785944244.307486:0:6478:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x7:0x0] 00010000:00010000:2.0:1785944244.307521:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b80031800/0xd90bab03aefd86ea lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.307528:0:6478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b80031800/0xd90bab03aefd86ea lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x2 rrc: 2 type: IBT flags: 0x0 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.307534:0:6478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b80031800/0xd90bab03aefd86ea lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x2 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785944244.307554:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a88eed500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839808:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1785944244.307666:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.307686:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b88403840 going to sleep for 11 seconds 00000100:00100000:3.0:1785944244.307742:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906839808 00000100:00100000:3.0:1785944244.307747:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906839808 00000100:00100000:3.0:1785944244.307765:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1785944244.307770:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a88eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6478:x1872697906839808:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785944244.307777:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785944244.307786:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd86f1 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd90bab03aefd86ea expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.307800:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd86f1 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd90bab03aefd86ea expref: 10 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.307809:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd86f1 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd86ea expref: 10 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.307826:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff967b84b00400) 00010000:00010000:3.0:1785944244.307829:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785944244.307831:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967a89640a00, rc 0) 00000100:00100000:3.0:1785944244.307889:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a88eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6478:x1872697906839808:12345-0@lo:101:mdt_io00_000.0 Request processed in 118us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944244.307895:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1785944244.308108:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a88eed500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839808:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1785944244.308119:0:6478:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b80031800/0xd90bab03aefd86ea lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd86f1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.308128:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b80031800/0xd90bab03aefd86ea lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd86f1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.308136:0:6478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b80031800/0xd90bab03aefd86ea lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd86f1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785944244.308183:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a88eed500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839936:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785944244.308207:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.308230:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b88403180 going to sleep for 11 seconds 00000100:00100000:1.0:1785944244.308290:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906839936 00000100:00100000:1.0:1785944244.308294:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906839936 00000100:00100000:1.0:1785944244.308316:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1785944244.308323:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6478:x1872697906839936:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785944244.308372:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6478:x1872697906839936:12345-0@lo:1000:mdt_io00_000.0 Request processed in 49us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944244.308378:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1785944244.308482:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a88eed500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906839936:0@lo:1000:mdt_io00_000.0 00000004:00080000:2.0:1785944244.308498:0:6478:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:2.0:1785944244.308640:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a88eed500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906840064:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785944244.308663:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.308681:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b88403180 going to sleep for 11 seconds 00000100:00100000:1.0:1785944244.308726:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906840064 00000100:00100000:1.0:1785944244.308734:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906840064 00000100:00100000:1.0:1785944244.308759:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1785944244.308764:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba78cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6478:x1872697906840064:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785944244.308810:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba78cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6478:x1872697906840064:12345-0@lo:1000:mdt_io00_000.0 Request processed in 45us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944244.308815:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1785944244.308928:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a88eed500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906840064:0@lo:1000:mdt_io00_000.0 00000004:00080000:2.0:1785944244.308944:0:6478:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x5:0x0] 00000100:00100000:2.0:1785944244.308967:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba78cc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906840192:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785944244.309088:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.309107:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b88403180 going to sleep for 11 seconds 00000100:00100000:3.0:1785944244.309154:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906840192 00000100:00100000:3.0:1785944244.309157:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906840192 00000100:00100000:3.0:1785944244.309175:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1785944244.309181:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba78cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6478:x1872697906840192:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.309245:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba78cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6478:x1872697906840192:12345-0@lo:1000:mdt_io00_000.0 Request processed in 63us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944244.309250:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1785944244.309305:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba78cc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906840192:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785944244.309363:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba78cc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906840320:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785944244.309394:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.309414:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b884036c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785944244.309461:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906840320 00000100:00100000:3.0:1785944244.309465:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906840320 00000100:00100000:3.0:1785944244.309482:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1785944244.309488:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba78cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6478:x1872697906840320:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.309649:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba78cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6478:x1872697906840320:12345-0@lo:1000:mdt_io00_000.0 Request processed in 160us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944244.309655:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1785944244.309757:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba78cc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906840320:0@lo:1000:mdt_io00_000.0 00000040:00080000:2.0:1785944244.310289:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].2, 560 off34408 00000100:00100000:2.0:1785944244.310350:0:6478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba78cc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906840448:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785944244.310388:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.310413:0:6478:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b88403cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785944244.310497:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906840448 00000100:00100000:3.0:1785944244.310501:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906840448 00000100:00100000:3.0:1785944244.310551:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1785944244.310558:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba78ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6478:x1872697906840448:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785944244.310764:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba78ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6478:x1872697906840448:12345-0@lo:1000:mdt_io00_000.0 Request processed in 206us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944244.310787:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1785944244.311367:0:6478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba78cc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6478:1872697906840448:0@lo:1000:mdt_io00_000.0 00000040:00080000:2.0:1785944244.311393:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].2, 640 off34632 00000004:00080000:2.0:1785944244.311400:0:6478:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff967b88403180 with version 5 00000004:00080000:3.0:1785944244.311694:0:7267:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff967b9195e840 version 5 rpc_version 5 00000020:00100000:3.0:1785944244.311715:0:7267:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785944244.311723:0:7267:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff967bbfde8a80 x1872697906840704/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1712/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785944244.311739:0:7267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfde8a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7267:1872697906840704:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785944244.311776:0:7267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944244.311836:0:7267:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840f780 going to sleep for 11 seconds 00000100:00100000:1.0:1785944244.312074:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906840704 00000100:00100000:1.0:1785944244.312078:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906840704 00000100:00100000:1.0:1785944244.312146:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1785944244.312156:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7267:x1872697906840704:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785944244.313096:0:7267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfde8a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7267:1872697906840704:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1785944244.313132:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:7267:x1872697906840704:12345-0@lo:1000:osp_up0-1.0 Request processed in 828us (1205us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1785944244.313142:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000004:00080000:2.0:1785944244.313235:0:6478:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x7:0x0] 00010000:00010000:2.0:1785944244.313243:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd86dc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd86e3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313253:0:6478:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b9809c600/0xd90bab03aefd86dc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd86e3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313264:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640c00/0xd90bab03aefd86ce lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313270:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640c00/0xd90bab03aefd86ce lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313278:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640c00/0xd90bab03aefd86ce lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313284:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967a89640c00 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:2.0:1785944244.313288:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640c00/0xd90bab03aefd86ce lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313302:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640c00/0xd90bab03aefd86ce lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313317:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff967b8acf8e00) 00010000:00010000:2.0:1785944244.313320:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944244.313325:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640c00/0xd90bab03aefd86ce lrc: 2/0,0 mode: --/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313331:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640c00/0xd90bab03aefd86ce lrc: 0/0,0 mode: --/CW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785944244.313345:0:6478:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8130ef7 reply state 00000000c53c630e transno 4294967312 ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640600/0xd90bab03aefd86d5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313357:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967a89640600/0xd90bab03aefd86d5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313363:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0xd04803f8 (ffff967b84b00d00) 00010000:00010000:2.0:1785944244.313366:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785944244.313368:0:6478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00080000:2.0:1785944244.313372:0:6478:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x6:0x0] 00010000:00010000:2.0:1785944244.313378:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641400/0xd90bab03aefd86b2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd86b9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313385:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641400/0xd90bab03aefd86b2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd90bab03aefd86b9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313391:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641400/0xd90bab03aefd86b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd90bab03aefd86b9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313425:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1785944244.313431:0:6478:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x6:0x0] 00010000:00010000:2.0:1785944244.313436:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641a00/0xd90bab03aefd86c0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd86c7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313444:0:6478:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641a00/0xd90bab03aefd86c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd90bab03aefd86c7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313452:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b80031800/0xd90bab03aefd86ea lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd90bab03aefd86f1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313458:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b80031800/0xd90bab03aefd86ea lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd90bab03aefd86f1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313465:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b80031800/0xd90bab03aefd86ea lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd90bab03aefd86f1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313480:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1785944244.313509:0:7273:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785944244.313514:0:7273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641400/0xd90bab03aefd86b2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd90bab03aefd86b9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313521:0:7273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967a89641400 already unused, calling callback (ffffffffc2226ee0) 00010000:00010000:2.0:1785944244.313525:0:7273:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641400/0xd90bab03aefd86b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd90bab03aefd86b9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785944244.313533:0:7273:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641400/0xd90bab03aefd86b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd90bab03aefd86b9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313645:0:7273:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641400/0xd90bab03aefd86b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd90bab03aefd86b9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313651:0:7273:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785944244.313670:0:7273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641400/0xd90bab03aefd86b2 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd90bab03aefd86b9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313677:0:7273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641400/0xd90bab03aefd86b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd90bab03aefd86b9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313693:0:7273:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785944244.313697:0:7273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b80031800/0xd90bab03aefd86ea lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd90bab03aefd86f1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313703:0:7273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967b80031800 already unused, calling callback (ffffffffc2226ee0) 00010000:00010000:2.0:1785944244.313706:0:7273:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b80031800/0xd90bab03aefd86ea lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd90bab03aefd86f1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785944244.313713:0:7273:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b80031800/0xd90bab03aefd86ea lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd90bab03aefd86f1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313728:0:7273:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b80031800/0xd90bab03aefd86ea lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd90bab03aefd86f1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313734:0:7273:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785944244.313748:0:7273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b80031800/0xd90bab03aefd86ea lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd90bab03aefd86f1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313767:0:7273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff967b80031800/0xd90bab03aefd86ea lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd90bab03aefd86f1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.313780:0:7273:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785944244.313781:0:7273:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785944244.313783:0:7273:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785944244.313796:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba78cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906840832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785944244.313829:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.313901:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967ba78cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906840960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785944244.313925:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944244.313959:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906840832 00000100:00100000:2.0:1785944244.313963:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906840832 00000100:00100000:2.0:1785944244.314098:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906840960 00000100:00100000:2.0:1785944244.314102:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906840960 00000100:00100000:2.0:1785944244.314131:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785944244.314139:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba78cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3474:x1872697906840832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785944244.314148:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785944244.314163:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809c000/0xd90bab03aefd86b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd90bab03aefd86b2 expref: 12 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.314175:0:6451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff967b8acf8100) 00010000:00010000:2.0:1785944244.314178:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785944244.314208:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba78cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3474:x1872697906840832:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944244.314214:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785944244.314228:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785944244.314242:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a88eed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3475:x1872697906840960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785944244.314250:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785944244.314262:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd86f1 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd90bab03aefd86ea expref: 10 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.314273:0:6451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff967b84b00400) 00010000:00010000:2.0:1785944244.314280:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785944244.314308:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a88eed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3475:x1872697906840960:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944244.314314:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785944244.314340:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba78cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906840960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785944244.314362:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967ba78cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906840832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785944244.314430:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfd61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+17:12394:x1872697880512384:12345-192.168.203.21@tcp:36:renameat2.0 Request processed in 17278us (17512us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1785944244.314437:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00010000:00010000:0.0:1785944244.314785:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785944244.328624:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944244.328699:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880512512 00000100:00100000:3.0:1785944244.328708:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880512512 00000100:00100000:3.0:1785944244.328760:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 72 00000100:00100000:3.0:1785944244.328769:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba78cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+17:12395:x1872697880512512:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1785944244.328790:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785944244.328818:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641600/0xd90bab03aefd86f8 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fcc9 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329220:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff967b80031800/0xd90bab03aefd86ff lrc: 3/1,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329234:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967b80031800/0xd90bab03aefd86ff lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329245:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967b80031800/0xd90bab03aefd86ff lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329255:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff967b80030600/0xd90bab03aefd8706 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329275:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967b80030600/0xd90bab03aefd8706 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329282:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967b80030600/0xd90bab03aefd8706 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329346:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff967b80030400/0xd90bab03aefd870d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329353:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff967b80030400/0xd90bab03aefd870d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329359:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff967b80030400/0xd90bab03aefd870d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785944244.329378:0:6465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff967b80030400/0xd90bab03aefd870d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329390:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff967b80031800/0xd90bab03aefd86ff lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329396:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff967b80031800/0xd90bab03aefd86ff lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329403:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff967b80031800/0xd90bab03aefd86ff lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329409:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967b80031800 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:2.0:1785944244.329413:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967b80031800/0xd90bab03aefd86ff lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329420:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967b80031800/0xd90bab03aefd86ff lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329437:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff967b8acf8e00) 00010000:00010000:2.0:1785944244.329440:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944244.329444:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff967b80031800/0xd90bab03aefd86ff lrc: 2/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329450:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967b80031800/0xd90bab03aefd86ff lrc: 0/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329464:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff967b80030600/0xd90bab03aefd8706 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329471:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff967b80030600/0xd90bab03aefd8706 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329476:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff967b80030600/0xd90bab03aefd8706 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329481:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967b80030600 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:2.0:1785944244.329484:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967b80030600/0xd90bab03aefd8706 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329489:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff967b80030600/0xd90bab03aefd8706 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329497:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0xd04803f8 (ffff967b84b00d00) 00010000:00010000:2.0:1785944244.329499:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785944244.329501:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff967b80030600/0xd90bab03aefd8706 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329608:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967b80030600/0xd90bab03aefd8706 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329648:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff967a89641600/0xd90bab03aefd86f8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fcc9 expref: 19 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329662:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff967b80030400/0xd90bab03aefd870d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fcc9 expref: 18 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785944244.329669:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff967b8acf8700) 00010000:00010000:2.0:1785944244.329671:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785944244.329673:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967b80030400, rc 0) 00000100:00100000:2.0:1785944244.329728:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba78cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+18:12395:x1872697880512512:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 959us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944244.329736:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 72 00000100:00100000:2.0:1785944244.333200:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944244.333258:0:9903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880512640 00000100:00100000:3.0:1785944244.333264:0:9903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880512640 00000100:00100000:3.0:1785944244.333306:0:9903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:3.0:1785944244.333315:0:9903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba78cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+13:12395:x1872697880512640:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1785944244.333330:0:9903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785944244.333345:0:9903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640800/0xd90bab03aefd8714 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fcd0 expref: -99 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.333389:0:9903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640000/0xd90bab03aefd871b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.333415:0:9903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640000/0xd90bab03aefd871b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.333426:0:9903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640000/0xd90bab03aefd871b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9903 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785944244.333460:0:9903:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 4 00000004:00200000:3.0:1785944244.333464:0:9903:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1785944244.333494:0:9903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640800/0xd90bab03aefd8714 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fcd0 expref: 15 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.333520:0:9903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640000/0xd90bab03aefd871b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fcd0 expref: 14 pid: 9903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.333529:0:9903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff967b84b00e00) 00010000:00010000:3.0:1785944244.333532:0:9903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785944244.333544:0:9903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967a89640000, rc 0) 00000100:00100000:3.0:1785944244.333758:0:9903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba78cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+14:12395:x1872697880512640:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 443us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944244.333765:0:9903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:0.0:1785944244.342307:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944244.342400:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880512768 00000100:00100000:3.0:1785944244.342409:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880512768 00000100:00100000:3.0:1785944244.342499:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00100000:3.0:1785944244.342512:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfd60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+14:12230:x1872697880512768:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1785944244.342532:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785944244.342619:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641200/0xd90bab03aefd8722 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x15b6b7153817fcd7 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.342700:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd8729 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.342713:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd8729 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.342723:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd8729 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.342733:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd8730 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.342743:0:6467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd86c7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd90bab03aefd86c0 expref: 8 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.342751:0:6467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd8730 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.342779:0:6467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd86c7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd90bab03aefd86c0 expref: 8 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785944244.342793:0:6467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfd15500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6467:1872697906841088:0@lo:104: 00000100:00100000:3.0:1785944244.344787:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785944244.344936:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906841088 00000100:00100000:0.0:1785944244.344942:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906841088 00000100:00100000:0.0:1785944244.344989:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1785944244.345005:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfd15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6467:x1872697906841088:12345-0@lo:104: 00010000:00010000:0.0:1785944244.345020:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641a00/0xd90bab03aefd86c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd90bab03aefd86c7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785944244.345249:0:6467:0:(client.c:2702:ptlrpc_set_wait()) set ffff967b8840fa80 going to sleep for 11 seconds 00010000:00010000:0.0:1785944244.345653:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785944244.345668:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfd15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6467:x1872697906841088:12345-0@lo:104: Request processed in 665us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944244.345675:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:1.0:1785944244.345734:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785944244.345740:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641a00/0xd90bab03aefd86c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd90bab03aefd86c7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.345749:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967a89641a00 already unused, calling callback (ffffffffc2226ee0) 00010000:00010000:1.0:1785944244.345753:0:6453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641a00/0xd90bab03aefd86c0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd90bab03aefd86c7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785944244.345761:0:6453:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641a00/0xd90bab03aefd86c0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd90bab03aefd86c7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.345789:0:6453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641a00/0xd90bab03aefd86c0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd90bab03aefd86c7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.345794:0:6453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785944244.346060:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641a00/0xd90bab03aefd86c0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd90bab03aefd86c7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.346068:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff967a89641a00/0xd90bab03aefd86c0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd90bab03aefd86c7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.346084:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785944244.346086:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785944244.346087:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785944244.346093:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785944244.346120:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a8868d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906841216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785944244.346152:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944244.346183:0:9943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906841216 00000100:00100000:1.0:1785944244.346187:0:9943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906841216 00010000:00010000:1.0:1785944244.346205:0:9943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd86c7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd90bab03aefd86c0 expref: 9 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785944244.346227:0:9943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1785944244.346232:0:9943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88cde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3475:x1872697906841216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785944244.346242:0:9943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1785944244.346652:0:6467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfd15500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6467:1872697906841088:0@lo:104: 00010000:00010000:3.0:1785944244.346671:0:6467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd8730 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785944244.371030:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967324 is committed 00010000:00010000:3.0:1785944244.379555:0:9943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967b9809ca00/0xd90bab03aefd86c7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd90bab03aefd86c0 expref: 8 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.379627:0:9943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x1c2f8c79 (ffff967b8acf8f00) 00010000:00010000:3.0:1785944244.379632:0:9943:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd8730 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.379641:0:9943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd8730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.379648:0:9943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd8730 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785944244.379712:0:9943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785944244.379789:0:9943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88cde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3475:x1872697906841216:12345-0@lo:103:ldlm_bl.0 Request processed in 33554us (33634us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944244.379798:0:9943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1785944244.379898:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a8868d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906841216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785944244.380212:0:6467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd8730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380221:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd8730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380455:0:6467:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd8729 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380463:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd8729 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380475:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd8729 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380482:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd8729 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380489:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967a89641600 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:1.0:1785944244.380492:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd8729 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380499:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd8729 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380511:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff967b8acf8100) 00010000:00010000:1.0:1785944244.380513:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785944244.380517:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd8729 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380523:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641600/0xd90bab03aefd8729 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380534:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd8730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380550:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd8730 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380555:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd8730 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380618:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff967a89640a00 already unused, calling callback (ffffffffc221a4f0) 00010000:00010000:1.0:1785944244.380627:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd8730 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380633:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd8730 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380643:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x1c2f8c79 (ffff967b8acf8f00) 00010000:00010000:1.0:1785944244.380645:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785944244.380648:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd8730 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380654:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967a89640a00/0xd90bab03aefd8730 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x1c2f8c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380696:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641200/0xd90bab03aefd8722 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fcd7 expref: 15 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380706:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff967b8acf8100) 00010000:00010000:1.0:1785944244.380708:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785944244.380711:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff967a89641200/0xd90bab03aefd8722 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x15b6b7153817fcd7 expref: 15 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785944244.380719:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff967a89641200, rc 0) 00000100:00100000:1.0:1785944244.380811:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfd60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+14:12230:x1872697880512768:12345-192.168.203.21@tcp:101:bash.0 Request processed in 38302us (38512us total) trans 0 rc 301/301 00000100:00100000:1.0:1785944244.380819:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 74 00010000:00010000:2.0:1785944244.437778:0:7273:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785944245.462402:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785944245.820217:0:14289:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_24Kb: @@@@@@ FAIL: test_24Kb failed with 1 00010000:00010000:1.0:1785944246.485164:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785944246.562072:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1785944246.562113:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1785944246.562142:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1785944246.562162:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1785944246.562181:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1785944246.562203:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880513408 00000100:00100000:2.0:1785944246.562211:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880513408 00000100:00100000:2.0:1785944246.562256:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880513280 00000100:00100000:2.0:1785944246.562259:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880513280 00000100:00100000:2.0:1785944246.562278:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 127 00000100:00100000:2.0:1785944246.562287:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:2408:x1872697880513408:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1785944246.562359:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:2408:x1872697880513408:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944246.562366:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 127 00000100:00100000:2.0:1785944246.562381:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 128 00000100:00100000:2.0:1785944246.562387:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:2408:x1872697880513280:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1785944246.562407:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:2408:x1872697880513280:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 21us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944246.562413:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 128 00000100:00100000:1.0:1785944246.562503:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880513152 00000100:00100000:1.0:1785944246.562508:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880513152 00000100:00100000:1.0:1785944246.562560:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880513024 00000100:00100000:1.0:1785944246.562569:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880513024 00000100:00100000:1.0:1785944246.562593:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 304 00000100:00100000:1.0:1785944246.562600:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8868d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+18:2408:x1872697880513152:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1785944246.562629:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8868d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+18:2408:x1872697880513152:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 30us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944246.562635:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 304 00000100:00100000:1.0:1785944246.562647:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 305 00000100:00100000:1.0:1785944246.562653:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+14:2408:x1872697880513024:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1785944246.562674:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+14:2408:x1872697880513024:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 22us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944246.562680:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 305 00000100:00080000:1.0:1785944246.562699:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785944246.562703:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1785944246.562706:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785944246.562707:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785944246.565785:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880512896 00000100:00100000:3.0:1785944246.565797:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880512896 00000100:00100000:3.0:1785944246.565877:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 349 00000100:00100000:3.0:1785944246.565888:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:241f1677-b528-438b-8353-7b94a079ece4+10:2408:x1872697880512896:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1785944246.565962:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:241f1677-b528-438b-8353-7b94a079ece4+10:2408:x1872697880512896:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 76us (3898us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944246.565969:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 349 00000100:00100000:1.0:1785944246.741877:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785944246.741899:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906841344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785944246.741965:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944246.742097:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906841344 00000100:00100000:2.0:1785944246.742105:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906841344 00000100:00100000:2.0:1785944246.742156:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1785944246.742165:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3474:x1872697906841344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1785944246.742204:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1785944246.742253:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3474:x1872697906841344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944246.742260:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1785944246.742305:0:3474:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1785944246.742310:0:3474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1785944246.742334:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3474:1872697906841344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785944246.746407:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785944246.746425:0:3473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3473:1872697906841472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785944246.746481:0:3473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944246.746546:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906841472 00000100:00100000:1.0:1785944246.746553:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906841472 00000100:00100000:1.0:1785944246.746591:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1785944246.746599:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3473:x1872697906841472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1785944246.746634:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1785944246.746675:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3473:x1872697906841472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944246.746688:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1785944246.746727:0:3473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3473:1872697906841472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785944247.254225:0:3476:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785944247.254246:0:3476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfd15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3476:1872697906841600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785944247.254315:0:3476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944247.254373:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906841600 00000100:00100000:3.0:1785944247.254390:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906841600 00000100:00100000:3.0:1785944247.254437:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1785944247.254446:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfd15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3476:x1872697906841600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785944247.254476:0:8101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785944247.254527:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfd15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3476:x1872697906841600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944247.254534:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1785944247.254650:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785944247.254691:0:3476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfd15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3476:1872697906841600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785944247.255755:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785944247.255765:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbfd15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906841728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785944247.255796:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785944247.255829:0:9688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906841728 00000100:00100000:3.0:1785944247.255834:0:9688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906841728 00000100:00100000:3.0:1785944247.255889:0:9688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1785944247.255896:0:9688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfd14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1872697906841728:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1785944247.256008:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1785944247.256385:0:9688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785944247.256431:0:9688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfd14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1872697906841728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 535us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944247.256439:0:9688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1785944247.256511:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbfd15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906841728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785944247.257210:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc1021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906842112:0@lo:400:kworker.0 00000100:00100000:1.0:1785944247.257244:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944247.257360:0:3473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc0fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77517232-4860-4396-96b0-aef00b03546e:3473:1872697906841856:0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.257394:0:3473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944247.257421:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785944247.257427:0:3473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc1023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3473:1872697906841984:0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.257450:0:3473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944247.257716:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906842112 00000100:00100000:1.0:1785944247.257722:0:7463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906842112 00000100:00100000:1.0:1785944247.257759:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1785944247.257766:0:7463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc1023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3475:x1872697906842112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785944247.257812:0:7463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc1023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3475:x1872697906842112:12345-0@lo:400:kworker.0 Request processed in 45us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944247.257819:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1785944247.257838:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906841984 00000100:00100000:1.0:1785944247.257841:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906841984 00000100:00100000:1.0:1785944247.257886:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1785944247.257893:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1872697906841984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.258354:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906841856 00000100:00100000:2.0:1785944247.258358:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906841856 00000100:00100000:2.0:1785944247.258391:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1785944247.258398:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b88543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77517232-4860-4396-96b0-aef00b03546e+24:3473:x1872697906841856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.259374:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b88543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77517232-4860-4396-96b0-aef00b03546e+24:3473:x1872697906841856:12345-0@lo:400:kworker.0 Request processed in 974us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944247.259382:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1785944247.263989:0:3473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc0fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77517232-4860-4396-96b0-aef00b03546e:3473:1872697906841856:0@lo:400:kworker.0 00000100:00100000:1.0:1785944247.265807:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1872697906841984:12345-0@lo:400:kworker.0 Request processed in 7909us (8350us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944247.265820:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1785944247.265884:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc1021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906842112:0@lo:400:kworker.0 00000100:00100000:1.0:1785944247.265956:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785944247.265966:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc1021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3475:1872697906842240:0@lo:400:kworker.0 00000100:00100000:1.0:1785944247.266008:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944247.266053:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906842240 00000100:00100000:1.0:1785944247.266059:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906842240 00000100:00100000:1.0:1785944247.266092:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1785944247.266099:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc1021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1872697906842240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785944247.266146:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc1021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1872697906842240:12345-0@lo:400:kworker.0 Request processed in 46us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1785944247.266152:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1785944247.266176:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc1021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3475:1872697906842240:0@lo:400:kworker.0 00000100:00100000:1.0:1785944247.266213:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc1021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3475:1872697906842624:0@lo:400:kworker.0 00000100:00100000:1.0:1785944247.266234:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944247.266283:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785944247.266290:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc1020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906842752:0@lo:400:kworker.0 00000100:00100000:1.0:1785944247.266313:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785944247.266362:0:3475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967a8ab46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3475:1872697906843136:0@lo:400:kworker.0 00000100:00100000:1.0:1785944247.266383:0:3475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944247.266995:0:9903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906842624 00000100:00100000:2.0:1785944247.267000:0:9903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906842624 00000100:00100000:2.0:1785944247.267037:0:9903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906843136 00000100:00100000:2.0:1785944247.267040:0:9903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906843136 00000100:00100000:2.0:1785944247.267057:0:9903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1785944247.267064:0:9903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc1020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1872697906842624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267103:0:9903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc1020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1872697906842624:12345-0@lo:400:kworker.0 Request processed in 40us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944247.267109:0:9903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1785944247.267120:0:9903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1785944247.267125:0:9903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967a8ab44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1872697906843136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267146:0:9903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967a8ab44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1872697906843136:12345-0@lo:400:kworker.0 Request processed in 21us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944247.267151:0:9903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1785944247.267166:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc1022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3474:1872697906842496:0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267186:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944247.267201:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbd3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3474:1872697906843008:0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267217:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944247.267227:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1785944247.267232:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bc1021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3474:1872697906842368:0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267272:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944247.267289:0:3474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff967bbd3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3474:1872697906842880:0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267308:0:3474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785944247.267328:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906842496 00000100:00100000:2.0:1785944247.267331:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906842496 00000100:00100000:2.0:1785944247.267346:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906843008 00000100:00100000:2.0:1785944247.267348:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906843008 00000100:00100000:2.0:1785944247.267358:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1785944247.267364:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1872697906842496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267394:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1872697906842496:12345-0@lo:400:kworker.0 Request processed in 30us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944247.267399:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1785944247.267409:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1785944247.267414:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1872697906843008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267435:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1872697906843008:12345-0@lo:400:kworker.0 Request processed in 22us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944247.267440:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1785944247.267454:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906842752 00000100:00100000:2.0:1785944247.267458:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906842752 00000100:00100000:2.0:1785944247.267477:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906842880 00000100:00100000:2.0:1785944247.267479:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906842880 00000100:00100000:2.0:1785944247.267493:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1785944247.267499:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbd3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1872697906842752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267546:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbd3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1872697906842752:12345-0@lo:400:kworker.0 Request processed in 38us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944247.267552:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1785944247.267564:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1785944247.267577:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967b86c85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1872697906842880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267604:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967b86c85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1872697906842880:12345-0@lo:400:kworker.0 Request processed in 29us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944247.267608:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1785944247.267631:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697906842368 00000100:00100000:2.0:1785944247.267634:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697906842368 00000100:00100000:2.0:1785944247.267658:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1785944247.267665:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfde8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3474:x1872697906842368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267695:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfde8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3474:x1872697906842368:12345-0@lo:400:kworker.0 Request processed in 31us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1785944247.267700:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1785944247.267743:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967a8ab46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3475:1872697906843136:0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267752:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc1020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3475:1872697906842752:0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267760:0:3475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc1021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3475:1872697906842624:0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267783:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc1021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3474:1872697906842368:0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267791:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbd3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3474:1872697906842880:0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267798:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc1022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3474:1872697906842496:0@lo:400:kworker.0 00000100:00100000:2.0:1785944247.267806:0:3474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bbd3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3474:1872697906843008:0@lo:400:kworker.0 00000100:00080000:1.0:1785944247.268740:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785944247.268745:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785944247.268748:0:6460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785944247.273473:0:3473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff967bc1023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3473:1872697906841984:0@lo:400:kworker.0 00010000:00010000:2.0:1785944247.509341:0:7273:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785944247.585316:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944247.585867:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880513536 00000100:00100000:0.0:1785944247.585877:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880513536 00002000:00100000:0.0:1785944247.585921:0:8104:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3:0x0] (0->3) req@ffff967bbfd15500 x1872697880513536/t0(0) o4->61cc2e2b-ebe4-44ac-97ef-8a806a502dd3@192.168.203.21@tcp:63/0 lens 496/0 e 0 to 0 dl 1785944258 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785944247.585932:0:8104:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff967bbfd15500 with x1872697880513536 ext(0->3) 00002000:00010000:0.0:1785944247.585938:0:8104:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff967bbfd15500 00000100:00100000:0.0:1785944247.585977:0:8104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:0.0:1785944247.585986:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bbfd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:2406:x1872697880513536:12345-192.168.203.21@tcp:4:bash.0 00000100:00100000:0.0:1785944247.586580:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bbfd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+9:2406:x1872697880513536:12345-192.168.203.21@tcp:4:bash.0 Request processed in 594us (1269us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1785944247.586588:0:8104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00002000:00100000:0.0:1785944247.586595:0:8104:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3:0x0] (0->3) req@ffff967bbfd15500 x1872697880513536/t4294967302(0) o4->61cc2e2b-ebe4-44ac-97ef-8a806a502dd3@192.168.203.21@tcp:63/0 lens 496/448 e 0 to 0 dl 1785944258 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785944247.586603:0:8104:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff967bbfd15500 with x1872697880513536 ext(0->3) 00002000:00010000:0.0:1785944247.586606:0:8104:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff967bbfd15500 00000100:00100000:3.0:1785944247.593401:0:3468:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1785944247.595831:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880513664 00000100:00100000:0.0:1785944247.595861:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880513664 00000100:00100000:0.0:1785944247.595914:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:0.0:1785944247.595924:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967bc0fba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+9:2405:x1872697880513664:12345-192.168.203.21@tcp:16:kworker.0 00000001:00080000:1.0:1785944247.636182:0:8127:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1785944247.637096:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967bc0fba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:2405:x1872697880513664:12345-192.168.203.21@tcp:16:kworker.0 Request processed in 41169us (43699us total) trans 0 rc 0/0 00000100:00100000:0.0:1785944247.637108:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:3.0:1785944247.660141:0:3467:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1785944247.660184:0:13457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880513792 00000100:00100000:3.0:1785944247.660203:0:13457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880513792 00002000:00100000:3.0:1785944247.660247:0:13457:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2:0x0] (0->3) req@ffff967ba7d7d880 x1872697880513792/t0(0) o4->61cc2e2b-ebe4-44ac-97ef-8a806a502dd3@192.168.203.21@tcp:63/0 lens 496/0 e 0 to 0 dl 1785944258 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785944247.660256:0:13457:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff967ba7d7d880 with x1872697880513792 ext(0->3) 00002000:00010000:3.0:1785944247.660260:0:13457:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff967ba7d7d880 00000100:00100000:3.0:1785944247.660284:0:13457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:3.0:1785944247.660292:0:13457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba7d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:2406:x1872697880513792:12345-192.168.203.21@tcp:4:bash.0 00000100:00100000:3.0:1785944247.660995:0:13457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba7d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+9:2406:x1872697880513792:12345-192.168.203.21@tcp:4:bash.0 Request processed in 701us (861us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1785944247.661003:0:13457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00002000:00100000:3.0:1785944247.661118:0:13457:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2:0x0] (0->3) req@ffff967ba7d7d880 x1872697880513792/t4294967303(0) o4->61cc2e2b-ebe4-44ac-97ef-8a806a502dd3@192.168.203.21@tcp:63/0 lens 496/448 e 0 to 0 dl 1785944258 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785944247.661127:0:13457:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff967ba7d7d880 with x1872697880513792 ext(0->3) 00002000:00010000:3.0:1785944247.661131:0:13457:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff967ba7d7d880 00000100:00100000:3.0:1785944247.668148:0:3466:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1785944247.669051:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872697880513920 00000100:00100000:2.0:1785944247.669060:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872697880513920 00000100:00100000:2.0:1785944247.669118:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:2.0:1785944247.669128:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff967ba7d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+9:2406:x1872697880513920:12345-192.168.203.21@tcp:16:kworker.0 00000001:00080000:1.0:1785944247.750664:0:8127:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1785944247.751031:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff967ba7d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61cc2e2b-ebe4-44ac-97ef-8a806a502dd3+7:2406:x1872697880513920:12345-192.168.203.21@tcp:16:kworker.0 Request processed in 81900us (82887us total) trans 0 rc 0/0 00000100:00100000:3.0:1785944247.751042:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 31 Debug log: 2928 lines, 2928 kept, 0 dropped, 0 bad.